00000001:02000400:3.0F:1782223994.775549:0:2958:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1782224015.426739:0:3179:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1782224017.222720:0:3221:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 723 MB/s 00000001:01000000:2.0:1782224017.472875:0:3221:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 595 MB/s 00000001:01000000:0.0:1782224017.725453:0:3221:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2830 MB/s 00000020:02000000:3.0:1782224018.583153:0:3272:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_83_g330a3f4 00000400:02000000:1.0F:1782224019.704538:0:3287:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.202.107@tcp [8/256/0/180] 00008000:02000000:0.0:1782224023.771963:0:3436:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1782224078.589560:0:5237:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1782224088.659209:0:5766:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782224088.659215:0:5766:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1782224088.659600:0:5766:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000001d0b75ed 00000080:02000400:2.0:1782224088.659613:0:5766:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1782224088.664231:0:5766:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1782224088.664252:0:5766:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1782224088.666788:0:5766:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000b464bf11) 00000020:00000080:2.0:1782224088.666829:0:5766:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1782224088.686534:0:5766:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1782224088.687095:0:5766:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1782224088.706771:0:5766:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1782224088.706812:0:5766:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1782224088.706833:0:5766:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1782224088.706881:0:5766:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1782224088.706902:0:5766:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1782224088.707451:0:5766:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1782224088.707459:0:5766:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782224088.707470:0:5766:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfd8b3ae4b1645bb 00000020:01000004:1.0:1782224088.707478:0:5766:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1782224088.707483:0:5766:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1782224088.707486:0:5766:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001d0b75ed from MGS 00000020:01000004:1.0:1782224088.707491:0:5766:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1782224088.707513:0:5766:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f8fdbefe) 00000020:00000080:1.0:1782224088.707525:0:5766:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1782224088.707634:0:5766:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001d0b75ed from MGS, refs=2 00080000:01000000:1.0:1782224088.707640:0:5766:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782224088.707645:0:5766:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfd8b3ae4b1645c9 00000100:00100000:1.0:1782224088.707737:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1782224088.707854:0:5766:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1782224088.707860:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1782224088.708545:0:5766:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1782224088.708551:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1782224088.709165:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782224088.709463:0:5766:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1782224088.709470:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1782224088.719102:0:5766:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1782224088.719141:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1782224088.719630:0:5766:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1782224088.719636:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1782224088.749241:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224088.749252:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224088.749254:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224088.750255:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224088.750259:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224088.750261:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224088.750768:0:5766:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1782224088.752598:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1782224089.000174:0:5766:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1579 MB/s 00000001:01000000:0.0:1782224089.250516:0:5766:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2955 MB/s 00000001:01000000:3.0:1782224089.503599:0:5766:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 355 MB/s 00000001:01000000:2.0:1782224089.753742:0:5766:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 563 MB/s 00080000:10000000:2.0:1782224089.762619:0:5766:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1782224089.802085:0:5766:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1782224089.802126:0:5766:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782224089.802129:0:5766:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1782224089.804501:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1782224089.804907:0:5766:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1782224089.804949:0:5766:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1782224089.805240:0:5766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1782224089.805267:0:5766:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1782224089.805720:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782224089.805890:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1782224089.805896:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1782224089.814447:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1782224089.814476:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00010000:00010000:3.0:1782224089.814554:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224089.820894:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1782224089.820908:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1782224089.827486:0:5766:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1782224089.827514:0:5766:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.202.107@tcp' 00000020:01000004:0.0:1782224089.827516:0:5766:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1782224089.827574:0:5766:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.202.107@tcp (typ=mgc) 00000020:00000080:0.0:1782224089.827599:0:5766:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.107@tcp (00000000f2cb563b) 00000020:00000080:0.0:1782224089.827620:0:5766:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1782224089.827752:0:5766:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000344d079d@MGC192.168.202.107@tcp: add connection 192.168.202.107@tcp at head 00000100:00080000:2.0:1782224089.828122:0:5782:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:0.0:1782224089.829346:0:5766:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.107@tcp-0 is initialized 00000040:01000000:0.0:1782224089.829356:0:5766:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.107@tcp ctxt 1 is initialized 10000000:01000000:1.0:1782224089.832261:0:5783:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1782224089.832309:0:5766:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.107@tcp (uuid b33607d9-62cb-4729-8187-59883763158a) 00000020:00000080:1.0:1782224089.832342:0:5766:0:(genops.c:1406:class_connect()) connect: client b33607d9-62cb-4729-8187-59883763158a, cookie 0xcfd8b3ae4b1645d7 00000100:00080000:1.0:1782224089.832354:0:5766:0:(import.c:512:import_select_connection()) MGC192.168.202.107@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782224089.832627:0:5766:0:(import.c:626:import_select_connection()) MGC192.168.202.107@tcp: import 00000000344d079d using connection 192.168.202.107@tcp/0@lo 00000100:00100000:1.0:1782224089.832678:0:5766:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d06b8635 x1868797332947072/t0(0) o250->MGC192.168.202.107@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782224089.832706:0:5766:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import b33607d9-62cb-4729-8187-59883763158a->MGS 00000020:01000004:1.0:1782224089.832728:0:5766:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1782224089.832734:0:5766:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1782224089.832747:0:5766:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000008b301662) 00000020:00000080:1.0:1782224089.832760:0:5766:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1782224089.837864:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d06b8635 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b33607d9-62cb-4729-8187-59883763158a:3302:1868797332947072:0@lo:250: 00000100:00100000:3.0:1782224089.837979:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224089.838087:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332947072 00000100:00100000:3.0:1782224089.838094:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332947072 00000100:00100000:3.0:1782224089.838140:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782224089.838146:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ec9996 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1868797332947072:12345-0@lo:250: 00010000:00080000:3.0:1782224089.838173:0:5779:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from b33607d9-62cb-4729-8187-59883763158a@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:3.0:1782224089.838217:0:5779:0:(genops.c:1406:class_connect()) connect: client b33607d9-62cb-4729-8187-59883763158a, cookie 0xcfd8b3ae4b1645e5 00000100:00080000:3.0:1782224089.838358:0:5779:0:(import.c:65:import_set_state_nolock()) 0000000056f6d074 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782224089.838434:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ec9996 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+5:3302:x1868797332947072:12345-0@lo:250: Request processed in 286us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224089.838441:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782224089.838485:0:3302:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.202.107@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1782224089.838493:0:3302:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.202.107@tcp: connect to target with instance 0 00000100:00080000:3.0:1782224089.838500:0:3302:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.202.107@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1782224089.838504:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1782224089.838513:0:3302:0:(import.c:65:import_set_state_nolock()) 00000000344d079d MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1782224089.838516:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1782224089.838519:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1782224089.838523:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d06b8635 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b33607d9-62cb-4729-8187-59883763158a:3302:1868797332947072:0@lo:250: 00000100:00100000:0.0:1782224089.860612:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782224089.860927:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1782224089.860934:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1782224089.861963:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1782224089.861971:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1782224089.862687:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1782224089.862694:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1782224089.864730:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782224089.864993:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1782224089.865008:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1782224089.865846:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1782224089.865854:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1782224089.931952:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782224089.932640:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1782224089.932648:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1782224089.934992:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1782224089.935006:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1782224089.936098:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782224089.936276:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1782224089.936281:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1782224089.937239:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782224089.937247:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1782224089.940515:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782224089.940715:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782224089.940722:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1782224089.941594:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782224089.941602:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1782224089.942604:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782224089.942765:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782224089.942770:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1782224089.943614:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782224089.943626:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1782224090.031514:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782224090.031746:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782224090.031754:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1782224090.034373:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782224090.034396:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1782224090.040174:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1782224090.040199:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1782224090.058255:0:5766:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1782224090.065938:0:5766:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1782224090.065949:0:5766:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.107@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1782224090.066554:0:5766:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.107@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782224090.066602:0:5766:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.107@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1782224090.066607:0:5766:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782224090.066608:0:5766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782224090.066610:0:5766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782224090.066611:0:5766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782224090.066612:0:5766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782224090.066613:0:5766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782224090.066614:0:5766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782224090.066615:0:5766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782224090.066617:0:5766:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782224090.066618:0:5766:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782224090.066619:0:5766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782224090.066620:0:5766:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782224090.066624:0:5766:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1782224090.066626:0:5766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782224090.066627:0:5766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782224090.066628:0:5766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782224090.066628:0:5766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782224090.066634:0:5766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782224090.066635:0:5766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782224090.066635:0:5766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782224090.066636:0:5766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782224090.066637:0:5766:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782224090.066637:0:5766:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782224090.066638:0:5766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782224090.066639:0:5766:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782224090.066684:0:5766:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1782224090.066703:0:5766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001d71a6db pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332947200:0@lo:253: 00000100:00100000:3.0:1782224090.066794:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224090.066867:0:5766:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c1fd324d going to sleep for 11 seconds 00000100:00100000:0.0:1782224090.066947:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332947200 00000100:00100000:0.0:1782224090.066955:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332947200 00000100:00100000:0.0:1782224090.067007:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782224090.067047:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a1690a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+5:5766:x1868797332947200:12345-0@lo:253: 20000000:01000000:0.0:1782224090.067112:0:5781:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782224090.067115:0:5781:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1782224090.067963:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1782224090.068055:0:5781:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1782224090.068447:0:5781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782224090.069785:0:5803:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1782224090.070340:0:5781:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782224090.070344:0:5781:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1782224090.070350:0:5781:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1782224090.070354:0:5781:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1782224090.070368:0:5781:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1782224090.070611:0:5781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782224090.070937:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1782224090.070950:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1782224090.070996:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1782224090.071073:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1782224090.071104:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1782224090.071181:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1782224090.071188:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1782224090.071223:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1782224090.071229:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1782224090.071254:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1782224090.071260:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1782224090.071283:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1782224090.071660:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1782224090.071694:0:5781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1782224090.071700:0:5781:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1782224090.071957:0:5781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782224090.072212:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1782224090.072226:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1782224090.072259:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1782224090.072372:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1782224090.072433:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1782224090.072444:0:5781:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1782224090.072537:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1782224090.072546:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1782224090.072587:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1782224090.072616:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1782224090.072642:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1782224090.072650:0:5781:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1782224090.073270:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1782224090.073283:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1782224090.073330:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1782224090.073358:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1782224090.073733:0:5781:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1782224090.073784:0:5781:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1782224090.073792:0:5781:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1782224090.075168:0:5804:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1782224090.075612:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1782224090.075641:0:5781:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.107@tcp for mdt 20000000:01000000:0.0:1782224090.075644:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.107@tcp (null) (null) (null) 00000040:00080000:0.0:1782224090.079135:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1782224090.079168:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1782224090.079244:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1782224090.079252:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.107@tcp (null) (null) 00000040:00080000:0.0:1782224090.080151:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1782224090.080168:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1782224090.080240:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1782224090.080273:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1782224090.081197:0:5781:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1782224090.081202:0:5781:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1782224090.081208:0:5781:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1782224090.081216:0:5781:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1782224090.085589:0:5805:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1782224090.086098:0:5781:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1782224090.105287:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1782224090.105335:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1782224090.105412:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1782224090.105434:0:5781:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1782224090.105437:0:5781:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1782224090.105441:0:5781:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1782224090.105455:0:5781:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782224090.105458:0:5781:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1782224090.105490:0:5781:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782224090.105492:0:5781:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782224090.111091:0:5806:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1782224090.111807:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1782224090.111858:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1782224090.112245:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1782224090.112260:0:5781:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782224090.112263:0:5781:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1782224090.113070:0:5807:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1782224090.113516:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1782224090.113563:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1782224090.113598:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1782224090.113611:0:5781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782224090.113614:0:5781:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1782224090.113621:0:5781:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782224090.113643:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d10e37b3/0xcfd8b3ae4b1645ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224090.113665:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d10e37b3/0xcfd8b3ae4b1645ec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224090.113677:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d10e37b3/0xcfd8b3ae4b1645ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224090.113683:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d10e37b3/0xcfd8b3ae4b1645ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224090.113688:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d10e37b3/0xcfd8b3ae4b1645ec lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224090.113694:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d10e37b3/0xcfd8b3ae4b1645ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224090.113699:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d10e37b3 already unused, calling callback (000000005d905c07) 00010000:00010000:0.0:1782224090.113702:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d10e37b3/0xcfd8b3ae4b1645ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224090.113723:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d10e37b3/0xcfd8b3ae4b1645ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224090.113734:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d10e37b3/0xcfd8b3ae4b1645ec lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224090.113748:0:5781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d10e37b3/0xcfd8b3ae4b1645ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224090.113753:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d10e37b3/0xcfd8b3ae4b1645ec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782224090.113772:0:5781:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1782224090.524791:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a1690a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+5:5766:x1868797332947200:12345-0@lo:253: Request processed in 457766us (457988us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224090.524832:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782224090.525134:0:5766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001d71a6db pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332947200:0@lo:253: 10000000:01000000:3.0:1782224090.525221:0:5766:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782224090.525226:0:5766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782224090.525228:0:5766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782224090.525246:0:5766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782224090.525247:0:5766:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1782224090.525248:0:5766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782224090.525250:0:5766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782224090.525251:0:5766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782224090.525253:0:5766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782224090.525255:0:5766:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1782224090.525257:0:5766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782224090.525322:0:5766:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782224090.525696:0:5766:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001d0b75ed from lustre-MDT0000 10000000:01000000:3.0:1782224090.525731:0:5766:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1782224090.525734:0:5766:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782224090.525740:0:5766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff96ea833bcd40 10000000:01000000:3.0:1782224090.525745:0:5766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782224090.525755:0:5766:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff96ea833bcd40 from 1 10000000:01000000:3.0:1782224090.525758:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782224090.525887:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: 000000000acb2349/0xcfd8b3ae4b1645f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224090.525902:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: 000000000acb2349/0xcfd8b3ae4b1645f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224090.525911:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: 000000000acb2349/0xcfd8b3ae4b1645f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224090.525935:0:5766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001d71a6db pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332947328:0@lo:101: 00000100:00100000:3.0:1782224090.525991:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224090.526348:0:5766:0:(client.c:2701:ptlrpc_set_wait()) set 000000002f1fb571 going to sleep for 11 seconds 00000100:00100000:0.0:1782224090.529746:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332947328 00000100:00100000:0.0:1782224090.529762:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332947328 00000100:00100000:2.0:1782224090.530663:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782224090.530689:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b574601f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+5:5766:x1868797332947328:12345-0@lo:101: 00010000:00010000:2.0:1782224090.530716:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224090.530746:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b1ea2080/0xcfd8b3ae4b1645fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1645f3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224090.530784:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b1ea2080/0xcfd8b3ae4b1645fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1645f3 expref: 6 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224090.530796:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b1ea2080/0xcfd8b3ae4b1645fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1645f3 expref: 6 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224090.530805:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b1ea2080, rc 0) 00000100:00100000:2.0:1782224090.530960:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b574601f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+6:5766:x1868797332947328:12345-0@lo:101: Request processed in 283us (4969us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224090.530967:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782224090.531106:0:5766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001d71a6db pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332947328:0@lo:101: 00010000:00010000:1.0:1782224090.531133:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: 000000000acb2349/0xcfd8b3ae4b1645f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1645fa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224090.531145:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: 000000000acb2349/0xcfd8b3ae4b1645f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b1645fa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224090.531263:0:5766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000023834c78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332947456:0@lo:501: 00000100:00100000:1.0:1782224090.531331:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224090.536845:0:5766:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fa5f177f going to sleep for 11 seconds 00000100:00100000:3.0:1782224090.539341:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332947456 00000100:00100000:3.0:1782224090.539361:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332947456 00000100:00100000:2.0:1782224090.539707:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782224090.539722:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b322f64e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+6:5766:x1868797332947456:12345-0@lo:501: 00000100:00100000:2.0:1782224090.540151:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b322f64e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+6:5766:x1868797332947456:12345-0@lo:501: Request processed in 432us (8818us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782224090.540273:0:5766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000023834c78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332947456:0@lo:501: 10000000:01000000:1.0:1782224090.540319:0:5766:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782224090.540355:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: 000000000acb2349/0xcfd8b3ae4b1645f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1645fa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224090.540365:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: 000000000acb2349/0xcfd8b3ae4b1645f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1645fa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224090.540373:0:5766:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96ea982ae000 10000000:01000000:1.0:1782224090.540391:0:5766:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782224090.540396:0:5766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff96ea982ae000 10000000:01000000:1.0:1782224090.540399:0:5766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1782224090.540402:0:5766:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff96ea982ae000 from 1 10000000:01000000:1.0:1782224090.540405:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1782224090.540444:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: 000000009dc6f949/0xcfd8b3ae4b164601 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224090.540453:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: 000000009dc6f949/0xcfd8b3ae4b164601 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224090.540462:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: 000000009dc6f949/0xcfd8b3ae4b164601 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224090.540482:0:5766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000023834c78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332947584:0@lo:101: 00000100:00100000:1.0:1782224090.540550:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224090.541460:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782224090.542850:0:5766:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fa5f177f going to sleep for 11 seconds 00000100:00100000:0.0:1782224090.546880:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332947584 00000100:00100000:0.0:1782224090.546962:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332947584 00000100:00100000:1.0:1782224090.550763:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224090.550780:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000534e17f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+6:5766:x1868797332947584:12345-0@lo:101: 00010000:00010000:1.0:1782224090.550805:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224090.550835:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000003eea65a/0xcfd8b3ae4b164608 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b164601 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224090.550889:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000003eea65a/0xcfd8b3ae4b164608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164601 expref: 7 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224090.550973:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000003eea65a/0xcfd8b3ae4b164608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164601 expref: 7 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224090.550983:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000003eea65a, rc 0) 00000100:00100000:2.0:1782224090.551879:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000534e17f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+7:5766:x1868797332947584:12345-0@lo:101: Request processed in 1100us (11326us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224090.551899:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224090.561254:0:5766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000023834c78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332947584:0@lo:101: 00010000:00010000:1.0:1782224090.561293:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: 000000009dc6f949/0xcfd8b3ae4b164601 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164608 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224090.561306:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: 000000009dc6f949/0xcfd8b3ae4b164601 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164608 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224090.561328:0:5766:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1782224090.561338:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: 000000009dc6f949/0xcfd8b3ae4b164601 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164608 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224090.561346:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: 000000009dc6f949/0xcfd8b3ae4b164601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164608 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224090.561355:0:5766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1782224090.561366:0:5766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782224090.561373:0:5766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff96ea982ae000 10000000:01000000:1.0:1782224090.561387:0:5766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1782224090.561392:0:5766:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1782224090.561395:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782224090.561425:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: 00000000a378ba7d/0xcfd8b3ae4b16460f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224090.561450:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: 00000000a378ba7d/0xcfd8b3ae4b16460f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224090.561460:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: 00000000a378ba7d/0xcfd8b3ae4b16460f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224090.561480:0:5766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000023834c78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332947712:0@lo:101: 00000100:00100000:1.0:1782224090.561546:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224090.561694:0:5766:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fa5f177f going to sleep for 11 seconds 00000100:00100000:3.0:1782224090.562188:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332947712 00000100:00100000:3.0:1782224090.562207:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332947712 00000100:00100000:3.0:1782224090.562298:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782224090.562308:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db9f019a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+7:5766:x1868797332947712:12345-0@lo:101: 00010000:00010000:3.0:1782224090.562345:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224090.562367:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e3e7843c/0xcfd8b3ae4b164616 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b16460f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224090.562410:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3e7843c/0xcfd8b3ae4b164616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16460f expref: 8 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224090.562515:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e3e7843c/0xcfd8b3ae4b164616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16460f expref: 8 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224090.562528:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e3e7843c, rc 0) 00000100:00100000:3.0:1782224090.562619:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db9f019a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+8:5766:x1868797332947712:12345-0@lo:101: Request processed in 313us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224090.562627:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782224090.562723:0:5766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000023834c78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332947712:0@lo:101: 00010000:00010000:1.0:1782224090.562742:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: 00000000a378ba7d/0xcfd8b3ae4b16460f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164616 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224090.562752:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: 00000000a378ba7d/0xcfd8b3ae4b16460f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164616 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224090.562822:0:5766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000023834c78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332947840:0@lo:501: 00000100:00100000:1.0:1782224090.562870:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224090.562985:0:5766:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fa5f177f going to sleep for 11 seconds 00000100:00100000:2.0:1782224090.563120:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332947840 00000100:00100000:2.0:1782224090.563129:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332947840 00000100:00100000:2.0:1782224090.563189:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782224090.563198:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000faf4a559 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+8:5766:x1868797332947840:12345-0@lo:501: 00000100:00100000:2.0:1782224090.563516:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000faf4a559 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+9:5766:x1868797332947840:12345-0@lo:501: Request processed in 318us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224090.563524:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782224090.563689:0:5766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000023834c78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332947840:0@lo:501: 00000100:00100000:1.0:1782224090.563721:0:5766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000023834c78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332947968:0@lo:503: 00000100:00100000:1.0:1782224090.563768:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224090.563796:0:5766:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fa5f177f going to sleep for 11 seconds 00000100:00100000:3.0:1782224090.563866:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332947968 00000100:00100000:3.0:1782224090.563871:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332947968 00000100:00100000:3.0:1782224090.563971:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782224090.563979:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea3b63ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+9:5766:x1868797332947968:12345-0@lo:503: 00000100:00100000:3.0:1782224090.564264:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea3b63ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+9:5766:x1868797332947968:12345-0@lo:503: Request processed in 285us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224090.564271:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782224090.564473:0:5766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000023834c78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332947968:0@lo:503: 00000100:00100000:2.0:1782224090.569219:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000040f18459 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:5809:1868797332948096:0@lo:502: 00000100:00100000:2.0:1782224090.569328:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224090.569454:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set 0000000097e2f0b1 going to sleep for 11 seconds 00000100:00100000:3.0:1782224090.574263:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332948096 00000100:00100000:3.0:1782224090.574279:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332948096 00000100:00100000:3.0:1782224090.574356:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782224090.574366:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad7250f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+9:5809:x1868797332948096:12345-0@lo:502: 00000100:00100000:3.0:1782224090.575992:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad7250f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+9:5809:x1868797332948096:12345-0@lo:502: Request processed in 1622us (6660us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224090.576008:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782224090.579868:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000040f18459 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:5809:1868797332948096:0@lo:502: 00000020:01000000:2.0:1782224090.580006:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782224090.580041:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224090.580043:0:5809:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1782224090.580116:0:5809:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1782224090.580124:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782224090.580141:0:5809:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000a277cbc1) 00000020:00000080:2.0:1782224090.580164:0:5809:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1782224090.580169:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1782224090.580264:0:5809:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1782224090.580271:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfd8b3ae4b164624 00000020:00000080:2.0:1782224090.581741:0:5809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1782224090.581754:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782224090.581764:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224090.581766:0:5809:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1782224090.581770:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782224090.581789:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224090.581791:0:5809:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1782224090.581796:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782224090.581810:0:5809:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000008d2fc0fb) 00000020:00000080:2.0:1782224090.581832:0:5809:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1782224090.581837:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1782224090.581839:0:5809:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1782224090.581842:0:5809:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1782224090.581850:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782224090.582155:0:5809:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001d0b75ed from lustre-MDT0000, refs=3 00000020:00000080:2.0:1782224090.582169:0:5809:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000006ac6b211) 00000020:00000080:2.0:1782224090.582178:0:5809:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1782224090.582251:0:5809:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1782224090.582258:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfd8b3ae4b164639 00000020:00000080:2.0:1782224090.582423:0:5809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1782224090.582430:0:5809:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1782224090.582436:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcfd8b3ae4b164640 00080000:01000000:2.0:1782224090.582441:0:5809:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1782224090.582445:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfd8b3ae4b164647 00080000:10000000:2.0:1782224090.584637:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1782224090.584918:0:5809:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1782224090.601196:0:5809:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1782224090.720758:0:5809:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1782224090.721934:0:5809:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1782224090.724607:0:5809:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1782224090.726006:0:5809:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1782224090.778768:0:5809:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b2291a7b) 00000020:00000080:2.0:1782224090.778796:0:5809:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1782224090.778902:0:5809:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1782224090.778910:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfd8b3ae4b164655 00000020:00000080:3.0:1782224090.783704:0:5809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1782224090.785491:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00010000:00010000:3.0:1782224090.836912:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1782224090.854209:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1782224090.901471:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1782224090.949291:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1782224090.991794:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782224091.034626:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1782224091.097664:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcfd8b3ae4b16465c 00000020:00000080:1.0:1782224091.098224:0:5809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1782224091.098237:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782224091.098251:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224091.098254:0:5809:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1782224091.098257:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782224091.098264:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224091.098265:0:5809:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1782224091.098269:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1782224091.098311:0:5809:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1782224091.098324:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782224091.098327:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224091.098328:0:5809:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1782224091.098331:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782224091.098334:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224091.098335:0:5809:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782224091.098338:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782224091.098339:0:5809:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1782224091.098397:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000004304bec pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:5809:1868797332948224:0@lo:502: 00000100:00100000:1.0:1782224091.098481:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224091.098704:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set 000000009b91aacb going to sleep for 11 seconds 00000100:00100000:3.0:1782224091.098767:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332948224 00000100:00100000:3.0:1782224091.098775:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332948224 00000100:00100000:3.0:1782224091.101895:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782224091.101919:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021b1aa39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+9:5809:x1868797332948224:12345-0@lo:502: 00000100:00100000:3.0:1782224091.102246:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021b1aa39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+9:5809:x1868797332948224:12345-0@lo:502: Request processed in 340us (3766us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224091.102254:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782224091.102443:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000004304bec pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:5809:1868797332948224:0@lo:502: 00000020:01000000:0.0:1782224091.102482:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782224091.102490:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224091.102492:0:5809:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782224091.102496:0:5809:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1782224091.103458:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1782224091.103486:0:5766:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782224091.103509:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: 00000000a378ba7d/0xcfd8b3ae4b16460f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164616 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224091.103538:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: 00000000a378ba7d/0xcfd8b3ae4b16460f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164616 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224091.103547:0:5766:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff96ea982ae000 from 1 10000000:01000000:2.0:1782224091.103550:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782224091.103616:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: 00000000dd9a744f/0xcfd8b3ae4b164663 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224091.103625:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: 00000000dd9a744f/0xcfd8b3ae4b164663 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224091.103635:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: 00000000dd9a744f/0xcfd8b3ae4b164663 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224091.103654:0:5766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c7318659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332948352:0@lo:101: 00000100:00100000:2.0:1782224091.103706:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224091.111838:0:5766:0:(client.c:2701:ptlrpc_set_wait()) set 0000000024cb0185 going to sleep for 11 seconds 00000100:00100000:1.0:1782224091.113146:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332948352 00000100:00100000:1.0:1782224091.113161:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332948352 00000100:00100000:1.0:1782224091.113222:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782224091.113231:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007aa037d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+9:5766:x1868797332948352:12345-0@lo:101: 00010000:00010000:1.0:1782224091.113249:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224091.113272:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000258199f5/0xcfd8b3ae4b16466a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b164663 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.113301:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000258199f5/0xcfd8b3ae4b16466a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164663 expref: 10 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.113313:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000258199f5/0xcfd8b3ae4b16466a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164663 expref: 10 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.113346:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000258199f5, rc 0) 00000100:00100000:1.0:1782224091.113438:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007aa037d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+10:5766:x1868797332948352:12345-0@lo:101: Request processed in 208us (9732us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224091.113446:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782224091.113601:0:5766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c7318659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332948352:0@lo:101: 00010000:00010000:2.0:1782224091.113620:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: 00000000dd9a744f/0xcfd8b3ae4b164663 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16466a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224091.113629:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: 00000000dd9a744f/0xcfd8b3ae4b164663 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b16466a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224091.114226:0:5766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c7318659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332948480:0@lo:256: 00000100:00100000:2.0:1782224091.114274:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224091.114302:0:5766:0:(client.c:2701:ptlrpc_set_wait()) set 0000000024cb0185 going to sleep for 11 seconds 00000100:00100000:1.0:1782224091.114506:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332948480 00000100:00100000:1.0:1782224091.114512:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332948480 00000100:00100000:1.0:1782224091.114538:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782224091.114544:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011b4d322 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+10:5766:x1868797332948480:12345-0@lo:256: 20000000:01000000:1.0:1782224091.114562:0:5781:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1782224091.114580:0:5781:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1782224091.114657:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011b4d322 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+10:5766:x1868797332948480:12345-0@lo:256: Request processed in 113us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224091.114664:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782224091.114782:0:5766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c7318659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332948480:0@lo:256: 10000000:01000000:2.0:1782224091.115530:0:5766:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782224091.115547:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: 00000000dd9a744f/0xcfd8b3ae4b164663 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16466a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224091.115558:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: 00000000dd9a744f/0xcfd8b3ae4b164663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16466a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224091.115567:0:5766:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96ea982ae000 from 1 10000000:01000000:2.0:1782224091.115570:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782224091.115841:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: 00000000448d605a/0xcfd8b3ae4b164671 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224091.115850:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: 00000000448d605a/0xcfd8b3ae4b164671 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224091.115859:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: 00000000448d605a/0xcfd8b3ae4b164671 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224091.115874:0:5766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c7318659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332948608:0@lo:101: 00000100:00100000:2.0:1782224091.115985:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224091.116097:0:5766:0:(client.c:2701:ptlrpc_set_wait()) set 0000000024cb0185 going to sleep for 11 seconds 00000100:00100000:0.0:1782224091.116799:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332948608 00000100:00100000:0.0:1782224091.116807:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332948608 00000100:00100000:1.0:1782224091.116869:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782224091.116880:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea60593a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+10:5766:x1868797332948608:12345-0@lo:101: 00010000:00010000:1.0:1782224091.116987:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224091.117004:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f801b70a/0xcfd8b3ae4b164678 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b164671 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.117059:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f801b70a/0xcfd8b3ae4b164678 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164671 expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.117069:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f801b70a/0xcfd8b3ae4b164678 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164671 expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.117076:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f801b70a, rc 0) 00000100:00100000:1.0:1782224091.117117:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea60593a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+11:5766:x1868797332948608:12345-0@lo:101: Request processed in 239us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224091.117136:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782224091.117229:0:5766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c7318659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332948608:0@lo:101: 00010000:00010000:2.0:1782224091.117243:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: 00000000448d605a/0xcfd8b3ae4b164671 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164678 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224091.117251:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: 00000000448d605a/0xcfd8b3ae4b164671 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164678 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224091.117318:0:5766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c7318659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332948736:0@lo:501: 00000100:00100000:2.0:1782224091.117346:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224091.117660:0:5766:0:(client.c:2701:ptlrpc_set_wait()) set 0000000024cb0185 going to sleep for 11 seconds 00000100:00100000:3.0:1782224091.117700:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332948736 00000100:00100000:3.0:1782224091.117706:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332948736 00000100:00100000:3.0:1782224091.117739:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782224091.117746:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017e7850a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+11:5766:x1868797332948736:12345-0@lo:501: 00000100:00100000:3.0:1782224091.118336:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017e7850a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+11:5766:x1868797332948736:12345-0@lo:501: Request processed in 589us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224091.118344:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782224091.118672:0:5766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c7318659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332948736:0@lo:501: 00000100:00100000:2.0:1782224091.118716:0:5766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c7318659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332948864:0@lo:503: 00000100:00100000:2.0:1782224091.118766:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224091.122784:0:5766:0:(client.c:2701:ptlrpc_set_wait()) set 0000000024cb0185 going to sleep for 11 seconds 00000100:00100000:3.0:1782224091.133970:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332948864 00000100:00100000:3.0:1782224091.133991:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332948864 00000100:00100000:3.0:1782224091.134080:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782224091.134089:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005981c93f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+11:5766:x1868797332948864:12345-0@lo:503: 00000040:00080000:3.0:1782224091.134169:0:5780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782224091.134257:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005981c93f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+11:5766:x1868797332948864:12345-0@lo:503: Request processed in 170us (15491us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224091.134273:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782224091.134672:0:5766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c7318659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332948864:0@lo:503: 00000040:00080000:2.0:1782224091.140420:0:5813:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1782224091.143305:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1782224091.143343:0:5766:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782224091.143431:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: 00000000448d605a/0xcfd8b3ae4b164671 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164678 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224091.143447:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: 00000000448d605a/0xcfd8b3ae4b164671 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164678 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224091.145805:0:5766:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782224091.145815:0:5766:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96ea982ae000 10000000:01000000:2.0:1782224091.145819:0:5766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96ea982ae000 10000000:01000000:2.0:1782224091.145827:0:5766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782224091.145835:0:5766:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff96ea982ae000 from 1 10000000:01000000:2.0:1782224091.145838:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782224091.145896:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: 00000000a3ef18ad/0xcfd8b3ae4b16467f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224091.145911:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: 00000000a3ef18ad/0xcfd8b3ae4b16467f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224091.145922:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: 00000000a3ef18ad/0xcfd8b3ae4b16467f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224091.145949:0:5766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c7318659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332948992:0@lo:101: 00000100:00100000:2.0:1782224091.146053:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224091.146130:0:5766:0:(client.c:2701:ptlrpc_set_wait()) set 0000000097e2f0b1 going to sleep for 11 seconds 00000100:00100000:0.0:1782224091.146691:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332948992 00000100:00100000:0.0:1782224091.146701:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332948992 00000100:00100000:0.0:1782224091.146766:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782224091.146774:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b4e9fe8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+11:5766:x1868797332948992:12345-0@lo:101: 00010000:00010000:0.0:1782224091.146789:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224091.146803:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d10e37b3/0xcfd8b3ae4b164686 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b16467f expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224091.146844:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d10e37b3/0xcfd8b3ae4b164686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16467f expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224091.146855:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d10e37b3/0xcfd8b3ae4b164686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16467f expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224091.146864:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d10e37b3, rc 0) 00000100:00100000:0.0:1782224091.147112:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b4e9fe8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+12:5766:x1868797332948992:12345-0@lo:101: Request processed in 338us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224091.147119:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782224091.147236:0:5766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c7318659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332948992:0@lo:101: 00010000:00010000:2.0:1782224091.147252:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: 00000000a3ef18ad/0xcfd8b3ae4b16467f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164686 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224091.147262:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: 00000000a3ef18ad/0xcfd8b3ae4b16467f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164686 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224091.147326:0:5766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c7318659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332949120:0@lo:501: 00000100:00100000:2.0:1782224091.147356:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224091.147392:0:5766:0:(client.c:2701:ptlrpc_set_wait()) set 0000000097e2f0b1 going to sleep for 11 seconds 00000100:00100000:0.0:1782224091.147444:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332949120 00000100:00100000:0.0:1782224091.147449:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332949120 00000100:00100000:0.0:1782224091.147496:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782224091.147503:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003439ac1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:5766:x1868797332949120:12345-0@lo:501: 00000100:00100000:0.0:1782224091.147949:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003439ac1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:5766:x1868797332949120:12345-0@lo:501: Request processed in 383us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224091.147957:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782224091.148725:0:5766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c7318659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332949120:0@lo:501: 00000100:00100000:2.0:1782224091.148773:0:5766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c7318659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332949248:0@lo:503: 00000100:00100000:2.0:1782224091.148832:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224091.148857:0:5766:0:(client.c:2701:ptlrpc_set_wait()) set 0000000097e2f0b1 going to sleep for 11 seconds 00000100:00100000:0.0:1782224091.148982:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332949248 00000100:00100000:0.0:1782224091.148988:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332949248 00000100:00100000:0.0:1782224091.149103:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782224091.149113:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d519b2f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+12:5766:x1868797332949248:12345-0@lo:503: 00000100:00100000:0.0:1782224091.149306:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d519b2f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+12:5766:x1868797332949248:12345-0@lo:503: Request processed in 194us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224091.149313:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782224091.149419:0:5766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c7318659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332949248:0@lo:503: 00000100:00100000:1.0:1782224091.152156:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001ebecccb pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:5814:1868797332949376:0@lo:502: 00000100:00100000:1.0:1782224091.152270:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224091.160776:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set 0000000049aa8b34 going to sleep for 11 seconds 00000100:00100000:3.0:1782224091.161085:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332949376 00000100:00100000:3.0:1782224091.161097:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332949376 00000100:00100000:3.0:1782224091.163221:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782224091.163235:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f99670da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+12:5814:x1868797332949376:12345-0@lo:502: 00000100:00100000:3.0:1782224091.163565:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f99670da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+12:5814:x1868797332949376:12345-0@lo:502: Request processed in 333us (11295us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224091.163584:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782224091.163796:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001ebecccb pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:5814:1868797332949376:0@lo:502: 00000020:01000004:1.0:1782224091.163917:0:5814:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1782224091.163932:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000a5a088ea) 00000020:00000080:1.0:1782224091.163954:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1782224091.164186:0:5814:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001d0b75ed from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782224091.164191:0:5814:0:(tgt_mount.c:187:server_put_mount()) put mount 000000001d0b75ed from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782224091.164194:0:5814:0:(obd_mount.c:701:lustre_put_lsi()) put 000000001d0b75ed 4 00010000:00080000:1.0:1782224091.164236:0:5814:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000051f51f1b@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.107@tcp at head 00010000:00010000:1.0:1782224091.167254:0:5814:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1782224091.177128:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1782224091.177214:0:5814:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782224091.177243:0:5814:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcfd8b3ae4b164694 00000100:00080000:1.0:1782224091.177255:0:5814:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782224091.177261:0:5814:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000051f51f1b using connection 192.168.202.107@tcp/0@lo 00000100:00100000:1.0:1782224091.177298:0:5814:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001ebecccb x1868797332949504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782224091.177368:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001ebecccb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868797332949504:0@lo:38: 00000100:00100000:3.0:1782224091.177451:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782224091.177522:0:5814:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782224091.177660:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332949504 00000100:00100000:2.0:1782224091.177668:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332949504 00000100:00100000:2.0:1782224091.177697:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782224091.177703:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb91e2b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1868797332949504:12345-0@lo:38: 00000100:00100000:1.0:1782224091.182294:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002f5a5534 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:5814:1868797332949632:0@lo:502: 00000100:00100000:1.0:1782224091.182408:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224091.182455:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set 0000000049aa8b34 going to sleep for 11 seconds 00000100:00100000:1.0:1782224091.182479:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332949632 00000100:00100000:1.0:1782224091.182486:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332949632 00000100:00100000:1.0:1782224091.182540:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782224091.182549:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d00486e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+12:5814:x1868797332949632:12345-0@lo:502: 00000100:00100000:1.0:1782224091.182870:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d00486e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+12:5814:x1868797332949632:12345-0@lo:502: Request processed in 321us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224091.182878:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782224091.184032:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002f5a5534 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:5814:1868797332949632:0@lo:502: 00000040:00080000:1.0:1782224091.184096:0:5814:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:2.0:1782224091.189137:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb91e2b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1868797332949504:12345-0@lo:38: Request processed in 11420us (11673us total) trans 0 rc -11/-11 00000100:00100000:2.0:1782224091.189154:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:2.0:1782224091.189302:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1782224091.189330:0:5766:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782224091.189349:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: 00000000a3ef18ad/0xcfd8b3ae4b16467f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164686 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224091.189393:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: 00000000a3ef18ad/0xcfd8b3ae4b16467f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164686 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782224091.189454:0:5766:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782224091.189456:0:5766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782224091.189458:0:5766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782224091.189459:0:5766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782224091.189461:0:5766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782224091.189462:0:5766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782224091.189463:0:5766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782224091.189465:0:5766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782224091.189466:0:5766:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782224091.189468:0:5766:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782224091.189469:0:5766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782224091.189471:0:5766:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782224091.189474:0:5766:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1782224091.189477:0:5766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782224091.189479:0:5766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782224091.189480:0:5766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782224091.189481:0:5766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782224091.189482:0:5766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782224091.189483:0:5766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782224091.189484:0:5766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782224091.189485:0:5766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782224091.189486:0:5766:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782224091.189487:0:5766:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782224091.189488:0:5766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782224091.189489:0:5766:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782224091.189542:0:5766:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782224091.189560:0:5766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c7318659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332949760:0@lo:253: 00000100:00100000:2.0:1782224091.189807:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224091.190711:0:5766:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bdc22684 going to sleep for 11 seconds 00000100:00100000:3.0:1782224091.190792:0:3302:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782224091.190800:0:3302:0:(import.c:65:import_set_state_nolock()) 0000000051f51f1b lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782224091.190805:0:3302:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1782224091.190809:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001ebecccb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868797332949504:0@lo:38: 00000100:00100000:0.0:1782224091.191794:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332949760 00000100:00100000:0.0:1782224091.191804:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332949760 00000100:00100000:0.0:1782224091.191862:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782224091.192773:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f25e3b73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:5766:x1868797332949760:12345-0@lo:253: 20000000:01000000:0.0:1782224091.192819:0:5779:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1782224091.192836:0:5779:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1782224091.269925:0:5779:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782224091.269948:0:5779:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1782224091.270054:0:5802:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1782224091.270060:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1782224091.270081:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000bb19988/0xcfd8b3ae4b16469b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224091.270123:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000258199f5/0xcfd8b3ae4b16466a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164663 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224091.270132:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000bb19988/0xcfd8b3ae4b16469b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224091.270171:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000258199f5/0xcfd8b3ae4b16466a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b164663 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224091.270186:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000258199f5/0xcfd8b3ae4b16466a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164663 expref: 12 pid: 5781 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224091.270201:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000071bfd165 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5802:1868797332949888:0@lo:104: 00000100:00100000:3.0:1782224091.270269:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224091.270330:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c7420f92 going to sleep for 11 seconds 00000100:00100000:1.0:1782224091.270779:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332949888 00000100:00100000:1.0:1782224091.270788:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332949888 00000100:00100000:1.0:1782224091.270840:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782224091.270849:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4303045 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+3:5802:x1868797332949888:12345-0@lo:104: 00010000:00010000:1.0:1782224091.270862:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: 00000000dd9a744f/0xcfd8b3ae4b164663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b16466a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.270928:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782224091.270933:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4303045 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+3:5802:x1868797332949888:12345-0@lo:104: Request processed in 86us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224091.270940:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1782224091.270962:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224091.270967:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: 00000000dd9a744f/0xcfd8b3ae4b164663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b16466a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.270974:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dd9a744f already unused, calling callback (0000000048e5213a) 10000000:00010000:1.0:1782224091.270978:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: 00000000dd9a744f/0xcfd8b3ae4b164663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b16466a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.270998:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: 00000000dd9a744f/0xcfd8b3ae4b164663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b16466a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224091.271005:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: 00000000dd9a744f/0xcfd8b3ae4b164663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b16466a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224091.271011:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782224091.271072:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: 00000000dd9a744f/0xcfd8b3ae4b164663 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16466a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.271079:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782224091.271097:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: 00000000dd9a744f/0xcfd8b3ae4b164663 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16466a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.271103:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: 00000000dd9a744f/0xcfd8b3ae4b164663 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16466a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.271120:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224091.271121:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224091.271123:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224091.271217:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782224091.271228:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002f5a5534 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797332950016:0@lo:103: 00000100:00100000:1.0:1782224091.271258:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224091.271299:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332950016 00000100:00100000:1.0:1782224091.271303:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332950016 00010000:00010000:1.0:1782224091.271319:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000258199f5/0xcfd8b3ae4b16466a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164663 expref: 13 pid: 5781 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224091.271341:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782224091.271347:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e5f003f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+13:3303:x1868797332950016:12345-0@lo:103: 00010000:00010000:1.0:1782224091.271366:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224091.271382:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000258199f5/0xcfd8b3ae4b16466a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164663 expref: 13 pid: 5781 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.271392:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000258199f5/0xcfd8b3ae4b16466a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164663 expref: 13 pid: 5781 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.271408:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000bb19988/0xcfd8b3ae4b16469b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.271416:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000bb19988/0xcfd8b3ae4b16469b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782224091.271430:0:5770:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001370631s 00010000:00010000:1.0:1782224091.271434:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000bb19988/0xcfd8b3ae4b16469b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.271441:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000bb19988/0xcfd8b3ae4b16469b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.271447:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000bb19988/0xcfd8b3ae4b16469b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.271452:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000bb19988/0xcfd8b3ae4b16469b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.271458:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000bb19988 already unused, calling callback (000000005d905c07) 00010000:00010000:1.0:1782224091.271461:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000bb19988/0xcfd8b3ae4b16469b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.271467:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000bb19988/0xcfd8b3ae4b16469b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.271480:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000bb19988/0xcfd8b3ae4b16469b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.271491:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224091.271520:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e5f003f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+13:3303:x1868797332950016:12345-0@lo:103: Request processed in 173us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224091.271527:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782224091.271561:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002f5a5534 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797332950016:0@lo:103: 00010000:00010000:1.0:1782224091.273112:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000258199f5/0xcfd8b3ae4b16466a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b164663 expref: 12 pid: 5781 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224091.273133:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000071bfd165 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5802:1868797332949888:0@lo:104: 00010000:00010000:1.0:1782224091.273149:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000bb19988/0xcfd8b3ae4b16469b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.273158:0:5802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000bb19988/0xcfd8b3ae4b16469b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.273163:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000bb19988/0xcfd8b3ae4b16469b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224091.273169:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000bb19988/0xcfd8b3ae4b16469b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224091.299420:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f25e3b73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+11:5766:x1868797332949760:12345-0@lo:253: Request processed in 107528us (109604us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224091.299438:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782224091.299547:0:5766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c7318659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:5766:1868797332949760:0@lo:253: 10000000:01000000:0.0:1782224091.299565:0:5766:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1782224091.299568:0:5766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782224091.299581:0:5766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782224091.299583:0:5766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782224091.299584:0:5766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782224091.299585:0:5766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782224091.299587:0:5766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782224091.299588:0:5766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782224091.299589:0:5766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782224091.299591:0:5766:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782224091.299593:0:5766:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782224091.299594:0:5766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782224091.299596:0:5766:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782224091.299611:0:5766:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1782224091.307255:0:5766:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1782224091.307600:0:5766:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1782224091.307812:0:5766:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1782224091.308046:0:5766:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1782224091.308257:0:5766:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1782224091.308451:0:5766:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1782224091.318250:0:5766:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1782224091.318498:0:5766:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1782224091.319131:0:5766:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1782224091.319320:0:5766:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1782224091.319538:0:5766:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1782224091.319753:0:5766:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1782224091.387922:0:5766:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1782224091.512436:0:5766:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1782224091.512846:0:5819:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1782224091.512857:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1782224091.513116:0:5820:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1782224091.518086:0:5766:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1782224091.526892:0:5766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1782224091.528287:0:5766:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1782224091.528346:0:5766:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1782224091.529465:0:5766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782224091.531848:0:5766:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1782224091.532966:0:5766:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1782224091.533168:0:5766:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1782224091.533654:0:5766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1782224091.534410:0:5766:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1782224091.542919:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1782224091.543541:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1782224091.543700:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1782224091.543878:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1782224091.544415:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1782224091.544570:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1782224091.544749:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1782224091.544883:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1782224091.545452:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1782224091.545747:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1782224091.545915:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1782224091.546104:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1782224091.546251:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1782224091.546430:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1782224091.548389:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1782224091.549216:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1782224091.549999:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1782224091.550184:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1782224091.550339:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1782224091.550490:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1782224091.550639:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1782224091.550787:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1782224091.550947:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1782224091.551109:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1782224091.551244:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1782224091.551360:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1782224091.551539:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1782224091.551677:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1782224091.551828:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1782224091.552133:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1782224091.553494:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1782224091.554174:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1782224091.554528:0:5766:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1782224091.605485:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1782224091.752194:0:5766:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1782224091.752247:0:5766:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb3d501db3988 00100000:10000000:0.0:1782224091.752257:0:5766:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1782224091.754919:0:5766:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782224091.754937:0:5766:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.107@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782224091.754955:0:5766:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1782224091.755640:0:5766:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1782224091.856078:0:5820:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1782224091.856186:0:5820:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1782224091.856192:0:5820:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1782224091.860423:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224092.888308:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224093.911560:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224094.933922:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224095.956365:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224096.342984:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008aa0e8c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332950144:0@lo:400: 00000100:00100000:0.0:1782224096.343084:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782224096.343246:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782224096.343252:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782224096.343254:0:37:0:(import.c:65:import_set_state_nolock()) 0000000051f51f1b lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782224096.343265:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000051f51f1b using connection 192.168.202.107@tcp/0@lo 00000100:00100000:3.0:1782224096.343288:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f9a59493 x1868797332950272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782224096.343332:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f9a59493 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868797332950272:0@lo:38: 00000100:00100000:3.0:1782224096.343424:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224096.343554:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332950144 00000100:00100000:1.0:1782224096.343564:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332950144 00000100:00100000:1.0:1782224096.343613:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782224096.343621:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffaa4f5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+11:3305:x1868797332950144:12345-0@lo:400: 00000100:00100000:1.0:1782224096.343824:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffaa4f5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+11:3305:x1868797332950144:12345-0@lo:400: Request processed in 203us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224096.343833:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782224096.343834:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332950272 00000100:00100000:2.0:1782224096.343850:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332950272 00000100:00100000:2.0:1782224096.343881:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782224096.343995:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083ad20e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1868797332950272:12345-0@lo:38: 00000100:00100000:0.0:1782224096.344006:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008aa0e8c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332950144:0@lo:400: 00010000:00080000:2.0:1782224096.344134:0:5788:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:2.0:1782224096.344175:0:5788:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcfd8b3ae4b1646a2 00000004:00100000:2.0:1782224096.344220:0:5788:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782224096.344347:0:5788:0:(import.c:65:import_set_state_nolock()) 000000001902994e : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782224096.344420:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083ad20e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1868797332950272:12345-0@lo:38: Request processed in 424us (996us total) trans 0 rc 0/0 00010000:00080000:3.0:1782224096.348464:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f9a59493 x1868797332950272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782224106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782224096.348489:0:3302:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1782224096.348507:0:3302:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1782224096.348512:0:3302:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782224096.348516:0:3302:0:(import.c:65:import_set_state_nolock()) 0000000051f51f1b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782224096.348525:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f9a59493 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868797332950272:0@lo:38: 00000100:00100000:2.0:1782224096.349137:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:1.0:1782224096.852338:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782224096.852348:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff96ea982ae000 from 3 10000000:01000000:1.0:1782224096.852352:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782224096.852411:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: 000000005ce5a287/0xcfd8b3ae4b1646a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224096.852506:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: 000000005ce5a287/0xcfd8b3ae4b1646a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224096.852518:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: 000000005ce5a287/0xcfd8b3ae4b1646a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224096.852544:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002f5a5534 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332950400:0@lo:101: 00000100:00100000:1.0:1782224096.852618:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224096.852674:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e55dd4a1 going to sleep for 11 seconds 00000100:00100000:2.0:1782224096.853620:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332950400 00000100:00100000:2.0:1782224096.853640:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332950400 00000100:00100000:2.0:1782224096.853742:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782224096.853754:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ec1e574 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+11:5783:x1868797332950400:12345-0@lo:101: 00010000:00010000:2.0:1782224096.853785:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224096.853818:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a0df606b/0xcfd8b3ae4b1646b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1646a9 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224096.853859:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a0df606b/0xcfd8b3ae4b1646b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1646a9 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224096.853872:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a0df606b/0xcfd8b3ae4b1646b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1646a9 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224096.853883:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a0df606b, rc 0) 00000100:00100000:2.0:1782224096.854002:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ec1e574 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:5783:x1868797332950400:12345-0@lo:101: Request processed in 248us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224096.854039:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782224096.854549:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002f5a5534 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332950400:0@lo:101: 00010000:00010000:2.0:1782224096.854575:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: 000000005ce5a287/0xcfd8b3ae4b1646a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1646b0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224096.854587:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: 000000005ce5a287/0xcfd8b3ae4b1646a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b1646b0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224096.854667:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e45281c3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332950528:0@lo:256: 00000100:00100000:2.0:1782224096.854722:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224096.854759:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 00000000100c5fb7 going to sleep for 11 seconds 00000100:00100000:1.0:1782224096.855896:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332950528 00000100:00100000:1.0:1782224096.855913:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332950528 00000100:00100000:1.0:1782224096.855996:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782224096.856006:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d67c684 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+12:5783:x1868797332950528:12345-0@lo:256: 20000000:01000000:1.0:1782224096.857483:0:5781:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782224096.857522:0:5781:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782224096.857527:0:5781:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1782224096.857713:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d67c684 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+12:5783:x1868797332950528:12345-0@lo:256: Request processed in 1707us (2988us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224096.857726:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782224096.858455:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e45281c3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332950528:0@lo:256: 10000000:01000000:2.0:1782224096.858547:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782224096.858561:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: 000000005ce5a287/0xcfd8b3ae4b1646a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1646b0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224096.858574:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: 000000005ce5a287/0xcfd8b3ae4b1646a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1646b0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224096.987688:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782224097.273975:0:6063:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782224098.005248:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224099.029434:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224100.055570:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224101.079881:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224101.464611:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782224101.464634:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000077cf9fb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332950656:0@lo:400: 00000100:00100000:0.0:1782224101.464651:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782224101.464711:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224101.464746:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332950656 00000100:00100000:2.0:1782224101.464754:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332950656 00000100:00100000:2.0:1782224101.464814:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782224101.464823:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000805f61a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:3305:x1868797332950656:12345-0@lo:400: 00000100:00100000:2.0:1782224101.464882:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000805f61a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:3305:x1868797332950656:12345-0@lo:400: Request processed in 60us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224101.464889:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782224101.464937:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000077cf9fb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332950656:0@lo:400: 00000100:00100000:0.0:1782224101.465137:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004f3bbeb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868797332950784:0@lo:400: 00000100:00100000:0.0:1782224101.465175:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224101.465246:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332950784 00000100:00100000:2.0:1782224101.465257:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332950784 00000100:00100000:2.0:1782224101.465303:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782224101.465309:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080a47099 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868797332950784:12345-0@lo:400: 00000100:00100000:2.0:1782224101.465344:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080a47099 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868797332950784:12345-0@lo:400: Request processed in 35us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224101.465349:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782224101.465467:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004f3bbeb4 x1868797332950784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224101.465479:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004f3bbeb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868797332950784:0@lo:400: 00010000:00010000:0.0:1782224102.100206:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782224102.854940:0:6265:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe03321800 20000000:00000080:2.0:1782224102.854962:0:6265:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96eabf87a400 uarg=0000000000000000 20000000:01000000:2.0:1782224102.855000:0:6265:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1782224102.855008:0:6265:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1782224102.855279:0:6265:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1782224102.855703:0:6265:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1782224102.855717:0:6265:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1782224102.863825:0:6265:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782224102.864929:0:6265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782224102.865009:0:6265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1782224102.865096:0:6265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1782224102.865121:0:6265:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782224102.865152:0:6265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000099afcbaf/0xcfd8b3ae4b1646b7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224102.865175:0:6265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f801b70a/0xcfd8b3ae4b164678 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164671 expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224102.865183:0:6265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000099afcbaf/0xcfd8b3ae4b1646b7 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224102.865229:0:6265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f801b70a/0xcfd8b3ae4b164678 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b164671 expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224102.865247:0:6265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f801b70a/0xcfd8b3ae4b164678 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164671 expref: 11 pid: 5781 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224102.865271:0:6265:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f9a59493 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6265:1868797332950912:0@lo:104: 00000100:00100000:3.0:1782224102.865345:0:6265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224102.865404:0:6265:0:(client.c:2701:ptlrpc_set_wait()) set 0000000085167041 going to sleep for 11 seconds 00000100:00100000:0.0:1782224102.865675:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332950912 00000100:00100000:0.0:1782224102.865686:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332950912 00000100:00100000:0.0:1782224102.865741:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782224102.865750:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000464c0643 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b33607d9-62cb-4729-8187-59883763158a+3:6265:x1868797332950912:12345-0@lo:104: 00010000:00010000:0.0:1782224102.865763:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: 00000000448d605a/0xcfd8b3ae4b164671 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164678 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224102.865834:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782224102.865839:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000464c0643 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b33607d9-62cb-4729-8187-59883763158a+3:6265:x1868797332950912:12345-0@lo:104: Request processed in 91us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224102.865846:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1782224102.865976:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782224102.865983:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: 00000000448d605a/0xcfd8b3ae4b164671 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164678 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224102.865992:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000448d605a already unused, calling callback (0000000048e5213a) 10000000:00010000:2.0:1782224102.865995:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: 00000000448d605a/0xcfd8b3ae4b164671 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b164678 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224102.866003:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: 00000000448d605a/0xcfd8b3ae4b164671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b164678 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782224102.866009:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: 00000000448d605a/0xcfd8b3ae4b164671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b164678 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224102.866041:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782224102.866076:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: 00000000448d605a/0xcfd8b3ae4b164671 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164678 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224102.866102:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782224102.866123:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: 00000000448d605a/0xcfd8b3ae4b164671 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164678 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224102.866140:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: 00000000448d605a/0xcfd8b3ae4b164671 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164678 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224102.866158:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224102.866160:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224102.866161:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224102.866169:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224102.866181:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e45281c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797332951040:0@lo:103: 00000100:00100000:2.0:1782224102.866216:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224102.866370:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332951040 00000100:00100000:1.0:1782224102.866376:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332951040 00010000:00010000:1.0:1782224102.866397:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f801b70a/0xcfd8b3ae4b164678 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164671 expref: 12 pid: 5781 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224102.866427:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782224102.866433:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006a5fb0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+12:3303:x1868797332951040:12345-0@lo:103: 00010000:00010000:1.0:1782224102.866444:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224102.866448:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f801b70a/0xcfd8b3ae4b164678 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164671 expref: 12 pid: 5781 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224102.866470:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f801b70a/0xcfd8b3ae4b164678 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164671 expref: 12 pid: 5781 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224102.866486:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000099afcbaf/0xcfd8b3ae4b1646b7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224102.866493:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000099afcbaf/0xcfd8b3ae4b1646b7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224102.866514:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000099afcbaf/0xcfd8b3ae4b1646b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224102.866520:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000099afcbaf/0xcfd8b3ae4b1646b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224102.866526:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000099afcbaf/0xcfd8b3ae4b1646b7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224102.866532:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000099afcbaf/0xcfd8b3ae4b1646b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224102.866537:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000099afcbaf already unused, calling callback (000000005d905c07) 00010000:00010000:1.0:1782224102.866541:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000099afcbaf/0xcfd8b3ae4b1646b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224102.866548:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000099afcbaf/0xcfd8b3ae4b1646b7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224102.866556:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000099afcbaf/0xcfd8b3ae4b1646b7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224102.866566:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224102.866601:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006a5fb0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+12:3303:x1868797332951040:12345-0@lo:103: Request processed in 169us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224102.866608:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782224102.866641:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e45281c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797332951040:0@lo:103: 00010000:00010000:3.0:1782224102.866844:0:6265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f801b70a/0xcfd8b3ae4b164678 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b164671 expref: 11 pid: 5781 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224102.866868:0:6265:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f9a59493 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6265:1868797332950912:0@lo:104: 00010000:00010000:3.0:1782224102.866886:0:6265:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000099afcbaf/0xcfd8b3ae4b1646b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224102.866895:0:6265:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000099afcbaf/0xcfd8b3ae4b1646b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224102.866901:0:6265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000099afcbaf/0xcfd8b3ae4b1646b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224102.866907:0:6265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000099afcbaf/0xcfd8b3ae4b1646b7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224103.133758:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224104.148656:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782224104.468115:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782224104.468126:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96ea982ae000 from 1 10000000:01000000:1.0:1782224104.468131:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782224104.468204:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: 00000000171f79d8/0xcfd8b3ae4b1646be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224104.468218:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: 00000000171f79d8/0xcfd8b3ae4b1646be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224104.468228:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: 00000000171f79d8/0xcfd8b3ae4b1646be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224104.468264:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008aec866b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332951168:0@lo:101: 00000100:00100000:1.0:1782224104.468342:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224104.468415:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d9d06387 going to sleep for 11 seconds 00000100:00100000:3.0:1782224104.468488:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332951168 00000100:00100000:3.0:1782224104.468497:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332951168 00000100:00100000:3.0:1782224104.468563:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782224104.468583:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e1d06e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+11:5783:x1868797332951168:12345-0@lo:101: 00010000:00010000:3.0:1782224104.468597:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224104.468612:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000840ffe24/0xcfd8b3ae4b1646c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1646be expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224104.468635:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000840ffe24/0xcfd8b3ae4b1646c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1646be expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224104.468644:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000840ffe24/0xcfd8b3ae4b1646c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1646be expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224104.468653:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000840ffe24, rc 0) 00000100:00100000:3.0:1782224104.468696:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e1d06e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+12:5783:x1868797332951168:12345-0@lo:101: Request processed in 126us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224104.468709:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782224104.468965:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008aec866b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332951168:0@lo:101: 00010000:00010000:1.0:1782224104.468981:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: 00000000171f79d8/0xcfd8b3ae4b1646be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1646c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224104.468988:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: 00000000171f79d8/0xcfd8b3ae4b1646be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b1646c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224104.469078:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008aec866b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332951296:0@lo:501: 00000100:00100000:1.0:1782224104.469108:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224104.469127:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d9d06387 going to sleep for 11 seconds 00000100:00100000:3.0:1782224104.469238:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332951296 00000100:00100000:3.0:1782224104.469256:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332951296 00000100:00100000:3.0:1782224104.469291:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782224104.469298:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032c65d23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+12:5783:x1868797332951296:12345-0@lo:501: 00000100:00100000:3.0:1782224104.469578:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032c65d23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+12:5783:x1868797332951296:12345-0@lo:501: Request processed in 273us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224104.469585:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782224104.469701:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008aec866b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332951296:0@lo:501: 00000100:00100000:0.0:1782224104.469733:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000aaf0f0c7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332951424:0@lo:503: 00000100:00100000:0.0:1782224104.469788:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224104.469819:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 0000000086c1c731 going to sleep for 11 seconds 00000100:00100000:3.0:1782224104.470182:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332951424 00000100:00100000:3.0:1782224104.470188:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332951424 00000100:00100000:3.0:1782224104.470215:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782224104.470221:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ae1c262 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:5783:x1868797332951424:12345-0@lo:503: 00000100:00100000:3.0:1782224104.470367:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ae1c262 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:5783:x1868797332951424:12345-0@lo:503: Request processed in 146us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224104.470373:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782224104.470453:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000aaf0f0c7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332951424:0@lo:503: 00000100:00100000:0.0:1782224104.471310:0:6326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000aaf0f0c7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:6326:1868797332951552:0@lo:502: 00000100:00100000:0.0:1782224104.471365:0:6326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224104.471399:0:6326:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d077b30b going to sleep for 11 seconds 00000100:00100000:3.0:1782224104.471448:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332951552 00000100:00100000:3.0:1782224104.471469:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332951552 00000100:00100000:3.0:1782224104.471508:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782224104.471515:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a813573d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:6326:x1868797332951552:12345-0@lo:502: 00000100:00100000:3.0:1782224104.472523:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a813573d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:6326:x1868797332951552:12345-0@lo:502: Request processed in 1005us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224104.472533:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782224104.486551:0:6326:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000aaf0f0c7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:6326:1868797332951552:0@lo:502: 00000020:01000000:0.0:1782224104.486623:0:6326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782224104.486639:0:6326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224104.486641:0:6326:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782224104.486649:0:6326:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96ea982ae000 00000020:00000080:0.0:1782224104.486652:0:6326:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782224104.486716:0:6326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:6326:1868797332951680:0@lo:502: 00000100:00100000:0.0:1782224104.486801:0:6326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224104.486851:0:6326:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832b0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782224104.487354:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332951680 00000100:00100000:1.0:1782224104.487362:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332951680 00000100:00100000:1.0:1782224104.487416:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782224104.487426:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+12:6326:x1868797332951680:12345-0@lo:502: 00000100:00100000:1.0:1782224104.487677:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+12:6326:x1868797332951680:12345-0@lo:502: Request processed in 251us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224104.487685:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782224104.487802:0:6326:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:6326:1868797332951680:0@lo:502: 00000020:01000000:2.0:1782224104.487828:0:6326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782224104.487836:0:6326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224104.487838:0:6326:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1782224104.487844:0:6326:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1782224104.488239:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782224104.488272:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782224104.488282:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1646be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1646c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224104.488294:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1646be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1646c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224105.174966:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224106.196929:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224106.580567:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332951808:0@lo:400: 00000100:00100000:2.0:1782224106.580676:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224106.580854:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797332951936:0@lo:400: 00000100:00100000:1.0:1782224106.580899:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224106.580953:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332951936 00000100:00100000:1.0:1782224106.580961:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332951936 00000100:00100000:1.0:1782224106.581044:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782224106.581053:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797332951936:12345-0@lo:400: 00000100:00100000:1.0:1782224106.581114:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797332951936:12345-0@lo:400: Request processed in 61us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224106.581121:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782224106.581166:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96eaa7a0ad80 x1868797332951936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224106.581182:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797332951936:0@lo:400: 00000100:00100000:0.0:1782224106.581467:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332951808 00000100:00100000:0.0:1782224106.581472:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332951808 00000100:00100000:0.0:1782224106.581510:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782224106.581517:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:3305:x1868797332951808:12345-0@lo:400: 00000100:00100000:0.0:1782224106.581920:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:3305:x1868797332951808:12345-0@lo:400: Request processed in 402us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224106.581927:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782224106.582101:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332951808:0@lo:400: 00010000:00010000:3.0:1782224107.220527:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224108.249354:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782224109.080700:0:6580:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782224109.080704:0:6580:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1782224109.080889:0:6580:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff96ea8341a800 00000020:01000004:3.0:1782224109.080913:0:6580:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1782224109.080924:0:6580:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1782224109.080954:0:6580:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff96ea83ec99c0) 00000020:00000080:3.0:1782224109.080972:0:6580:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1782224109.126830:0:6580:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1782224109.132592:0:6580:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1782224109.165433:0:6580:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1782224109.173986:0:6580:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1782224109.174274:0:6580:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1782224109.174413:0:6580:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1782224109.174443:0:6580:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1782224109.174961:0:6580:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1782224109.174972:0:6580:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782224109.174982:0:6580:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcfd8b3ae4b1646d3 00000020:01000004:3.0:1782224109.174991:0:6580:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1782224109.175012:0:6580:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.107@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782224109.175243:0:6580:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.107@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782224109.175251:0:6580:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1782224109.175258:0:6580:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1782224109.175273:0:6580:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff96ea83ec8000) 00000020:00000080:3.0:1782224109.175285:0:6580:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1782224109.177275:0:6580:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782224109.177822:0:6580:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1782224109.177828:0:6580:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1782224109.190892:0:6580:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1782224109.190913:0:6580:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1782224109.191920:0:6580:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1782224109.191934:0:6580:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1782224109.195358:0:6580:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782224109.195649:0:6580:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1782224109.195655:0:6580:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1782224109.197386:0:6580:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1782224109.197399:0:6580:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1782224109.231698:0:6580:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782224109.232406:0:6580:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782224109.232415:0:6580:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1782224109.234471:0:6580:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1782224109.234617:0:6580:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1782224109.236967:0:6580:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1782224109.236987:0:6580:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1782224109.241294:0:6580:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782224109.241678:0:6580:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1782224109.241685:0:6580:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1782224109.242867:0:6580:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1782224109.242878:0:6580:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:3.0:1782224109.274637:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224109.349666:0:6580:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782224109.349964:0:6580:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1782224109.349972:0:6580:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1782224109.351982:0:6580:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1782224109.351995:0:6580:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1782224109.352683:0:6580:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1782224109.352708:0:6580:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1782224109.352724:0:6580:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.107@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1782224109.411742:0:6580:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.107@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782224109.411785:0:6580:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.107@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1782224109.411789:0:6580:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782224109.411791:0:6580:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782224109.411793:0:6580:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782224109.411794:0:6580:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782224109.411795:0:6580:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782224109.411796:0:6580:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782224109.411798:0:6580:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782224109.411799:0:6580:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782224109.411801:0:6580:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782224109.411803:0:6580:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782224109.411804:0:6580:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782224109.411808:0:6580:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1782224109.411810:0:6580:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782224109.411812:0:6580:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782224109.411813:0:6580:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782224109.411814:0:6580:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782224109.411815:0:6580:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782224109.411816:0:6580:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782224109.411818:0:6580:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782224109.411819:0:6580:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782224109.411820:0:6580:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782224109.411821:0:6580:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782224109.411822:0:6580:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782224109.411850:0:6580:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782224109.411874:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf236d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332952064:0@lo:253: 00000100:00100000:2.0:1782224109.411955:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224109.412273:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224109.412982:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332952064 00000100:00100000:0.0:1782224109.412994:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332952064 00000100:00100000:0.0:1782224109.413090:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782224109.413099:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+12:6580:x1868797332952064:12345-0@lo:253: 20000000:01000000:0.0:1782224109.413147:0:5781:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1782224109.413152:0:5781:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1782224109.413157:0:5781:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1782224109.413161:0:5781:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1782224109.414517:0:5781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782224109.414796:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1782224109.414809:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1782224109.414985:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1782224109.414993:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1782224109.415216:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1782224109.415256:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1782224109.415582:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1782224109.415601:0:5781:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.107@tcp 20000000:01000000:0.0:1782224109.415603:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.107@tcp (null) (null) (null) 00000040:00080000:0.0:1782224109.415627:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1782224109.415631:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1782224109.415656:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1782224109.415660:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.107@tcp (null) (null) 00000040:00080000:0.0:1782224109.415748:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1782224109.415773:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1782224109.415799:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1782224109.415838:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1782224109.416901:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1782224109.416923:0:5781:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.107@tcp 20000000:01000000:0.0:1782224109.416926:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.107@tcp (null) (null) (null) 00000040:00080000:0.0:1782224109.416963:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1782224109.416973:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1782224109.422484:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1782224109.422525:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.107@tcp (null) (null) 00000040:00080000:0.0:1782224109.422674:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1782224109.422687:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1782224109.422722:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1782224109.422763:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1782224109.422791:0:5781:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1782224109.422794:0:5781:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1782224109.422799:0:5781:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1782224109.422815:0:5781:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782224109.422818:0:5781:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1782224109.422872:0:5781:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782224109.422874:0:5781:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782224109.423784:0:6595:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1782224109.423851:0:6595:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1782224109.423903:0:6595:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1782224109.424416:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1782224109.424459:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1782224109.424520:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1782224109.424534:0:5781:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782224109.424537:0:5781:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782224109.425373:0:6596:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1782224109.425433:0:6596:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1782224109.425481:0:6596:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1782224109.426002:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1782224109.426077:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1782224109.426771:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1782224109.426792:0:5781:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1782224109.426794:0:5781:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782224109.431659:0:6597:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1782224109.432345:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1782224109.435673:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1782224109.435792:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1782224109.435821:0:5781:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1782224109.435823:0:5781:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1782224109.435834:0:5781:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782224109.435856:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96eabb711600/0xcfd8b3ae4b1646e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.435875:0:5781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96eabb610800/0xcfd8b3ae4b1645fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1645f3 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.435883:0:5781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96eabb710400/0xcfd8b3ae4b164616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16460f expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.435890:0:5781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea80031600/0xcfd8b3ae4b164686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16467f expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.435898:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96eabb711600/0xcfd8b3ae4b1646e1 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.435938:0:5781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea80031600/0xcfd8b3ae4b164686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b16467f expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.435956:0:5781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96ea80031600/0xcfd8b3ae4b164686 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16467f expref: 12 pid: 5781 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224109.435972:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5781:1868797332952192:0@lo:104: 00000100:00100000:3.0:1782224109.437619:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782224109.437752:0:5781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96eabb710400/0xcfd8b3ae4b164616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b16460f expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.437788:0:5781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96eabb710400/0xcfd8b3ae4b164616 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16460f expref: 12 pid: 5780 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224109.437801:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5781:1868797332952320:0@lo:104: 00000100:00100000:3.0:1782224109.437848:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782224109.462310:0:5781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96eabb610800/0xcfd8b3ae4b1645fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b1645f3 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.462329:0:5781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96eabb610800/0xcfd8b3ae4b1645fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1645f3 expref: 12 pid: 5780 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224109.462344:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5781:1868797332952448:0@lo:104: 00000100:00100000:3.0:1782224109.462401:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224109.462494:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332952192 00000100:00100000:1.0:1782224109.462519:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332952192 00000100:00100000:1.0:1782224109.462570:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332952320 00000100:00100000:1.0:1782224109.462573:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332952320 00000100:00100000:1.0:1782224109.462589:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782224109.462597:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+4:5781:x1868797332952192:12345-0@lo:104: 00010000:00010000:1.0:1782224109.462612:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eabb611600/0xcfd8b3ae4b16467f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164686 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.462678:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782224109.462684:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+4:5781:x1868797332952192:12345-0@lo:104: Request processed in 88us (25074us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224109.462692:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782224109.462709:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782224109.462716:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+3:5781:x1868797332952320:12345-0@lo:104: 00010000:00010000:1.0:1782224109.462724:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16460f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164616 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.462760:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782224109.462765:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+3:5781:x1868797332952320:12345-0@lo:104: Request processed in 50us (24917us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224109.462771:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1782224109.462787:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782224109.462792:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabb611600/0xcfd8b3ae4b16467f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164686 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.462800:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabb611600 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:1.0:1782224109.462803:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabb611600/0xcfd8b3ae4b16467f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b164686 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.462823:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabb611600/0xcfd8b3ae4b16467f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b164686 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224109.462830:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabb611600/0xcfd8b3ae4b16467f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b164686 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224109.462836:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782224109.462869:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabb611600/0xcfd8b3ae4b16467f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164686 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.462876:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782224109.462894:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabb611600/0xcfd8b3ae4b16467f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164686 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.462902:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabb611600/0xcfd8b3ae4b16467f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164686 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.462918:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224109.462922:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16460f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164616 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.462927:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876c00 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:1.0:1782224109.462930:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16460f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b164616 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.462937:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16460f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b164616 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224109.462943:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16460f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b164616 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224109.462954:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782224109.462969:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16460f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164616 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.462975:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782224109.462982:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16460f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164616 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.462987:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16460f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164616 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.462996:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224109.462997:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224109.462998:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224109.463041:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797332952576:0@lo:103: 00000100:00100000:1.0:1782224109.463072:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224109.463097:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782224109.463103:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797332952704:0@lo:103: 00000100:00100000:1.0:1782224109.463124:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224109.463154:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332952576 00000100:00100000:1.0:1782224109.463157:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332952576 00010000:00010000:1.0:1782224109.463176:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea80031600/0xcfd8b3ae4b164686 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16467f expref: 13 pid: 5781 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224109.463208:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332952704 00000100:00100000:1.0:1782224109.463211:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332952704 00010000:00010000:1.0:1782224109.463223:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96eabb710400/0xcfd8b3ae4b164616 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16460f expref: 14 pid: 5780 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224109.463251:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782224109.463257:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+14:3303:x1868797332952576:12345-0@lo:103: 00010000:00010000:1.0:1782224109.463269:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224109.463275:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea80031600/0xcfd8b3ae4b164686 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16467f expref: 14 pid: 5781 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.463286:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea80031600/0xcfd8b3ae4b164686 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16467f expref: 14 pid: 5781 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.463303:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224109.463332:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+14:3303:x1868797332952576:12345-0@lo:103: Request processed in 75us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224109.463339:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782224109.463352:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782224109.463358:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+13:3303:x1868797332952704:12345-0@lo:103: 00010000:00010000:1.0:1782224109.463365:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224109.463370:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96eabb710400/0xcfd8b3ae4b164616 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16460f expref: 13 pid: 5780 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.463378:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96eabb710400/0xcfd8b3ae4b164616 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16460f expref: 13 pid: 5780 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.463387:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224109.463406:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+13:3303:x1868797332952704:12345-0@lo:103: Request processed in 49us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224109.463412:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782224109.463458:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797332952704:0@lo:103: 00000100:00100000:1.0:1782224109.463473:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797332952576:0@lo:103: 00010000:00010000:2.0:1782224109.466011:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224109.469190:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832ed9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1782224109.469267:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea80031600/0xcfd8b3ae4b164686 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b16467f expref: 12 pid: 5781 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224109.469290:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5781:1868797332952192:0@lo:104: 00010000:00010000:3.0:1782224109.469305:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabb710400/0xcfd8b3ae4b164616 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b16460f expref: 11 pid: 5780 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224109.469316:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5781:1868797332952320:0@lo:104: 00000100:00100000:1.0:1782224109.469610:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332952448 00000100:00100000:1.0:1782224109.469632:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332952448 00000100:00100000:1.0:1782224109.469688:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224109.469698:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+3:5781:x1868797332952448:12345-0@lo:104: 00010000:00010000:1.0:1782224109.469716:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eabb710e00/0xcfd8b3ae4b1645f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1645fa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.469812:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782224109.469819:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+3:5781:x1868797332952448:12345-0@lo:104: Request processed in 122us (7417us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224109.469827:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1782224109.469899:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782224109.469904:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabb710e00/0xcfd8b3ae4b1645f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1645fa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.469910:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabb710e00 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:2.0:1782224109.469913:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabb710e00/0xcfd8b3ae4b1645f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b1645fa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.469920:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabb710e00/0xcfd8b3ae4b1645f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b1645fa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782224109.469924:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabb710e00/0xcfd8b3ae4b1645f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b1645fa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224109.469928:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782224109.469971:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabb710e00/0xcfd8b3ae4b1645f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1645fa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.469976:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782224109.469990:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabb710e00/0xcfd8b3ae4b1645f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1645fa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.469995:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabb710e00/0xcfd8b3ae4b1645f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1645fa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.470010:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224109.470011:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224109.470078:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224109.470090:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332952832:0@lo:103: 00000100:00100000:2.0:1782224109.470134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224109.470405:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332952832 00000100:00100000:1.0:1782224109.470409:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332952832 00010000:00010000:1.0:1782224109.470425:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96eabb610800/0xcfd8b3ae4b1645fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1645f3 expref: 11 pid: 5780 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224109.470449:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224109.470454:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf235f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+11:3305:x1868797332952832:12345-0@lo:103: 00010000:00010000:1.0:1782224109.470463:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224109.470466:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96eabb610800/0xcfd8b3ae4b1645fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1645f3 expref: 11 pid: 5780 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.470474:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96eabb610800/0xcfd8b3ae4b1645fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1645f3 expref: 11 pid: 5780 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.470489:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96eabb711600/0xcfd8b3ae4b1646e1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.470504:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabb711600/0xcfd8b3ae4b1646e1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.470517:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96eabb711600/0xcfd8b3ae4b1646e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.470522:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96eabb711600/0xcfd8b3ae4b1646e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.470529:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96eabb711600/0xcfd8b3ae4b1646e1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.470535:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96eabb711600/0xcfd8b3ae4b1646e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.470540:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabb711600 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224109.470545:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96eabb711600/0xcfd8b3ae4b1646e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.470552:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96eabb711600/0xcfd8b3ae4b1646e1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.470560:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96eabb711600/0xcfd8b3ae4b1646e1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.470569:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224109.470599:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf235f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+11:3305:x1868797332952832:12345-0@lo:103: Request processed in 145us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224109.470604:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224109.470624:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332952832:0@lo:103: 00010000:00010000:3.0:1782224109.470789:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabb610800/0xcfd8b3ae4b1645fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b1645f3 expref: 10 pid: 5780 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224109.470798:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5781:1868797332952448:0@lo:104: 00010000:00010000:3.0:1782224109.470815:0:5781:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96eabb711600/0xcfd8b3ae4b1646e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.470827:0:5781:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96eabb711600/0xcfd8b3ae4b1646e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.470831:0:5781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96eabb711600/0xcfd8b3ae4b1646e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.470836:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabb711600/0xcfd8b3ae4b1646e1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782224109.470846:0:5781:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1782224109.719245:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+9:6580:x1868797332952064:12345-0@lo:253: Request processed in 306135us (307278us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224109.719266:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782224109.719491:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf236d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332952064:0@lo:253: 10000000:01000000:3.0:1782224109.719508:0:6580:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1782224109.719511:0:6580:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782224109.719513:0:6580:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782224109.719514:0:6580:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782224109.719515:0:6580:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1782224109.719517:0:6580:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782224109.719518:0:6580:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782224109.719532:0:6580:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782224109.719534:0:6580:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1782224109.719535:0:6580:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782224109.719536:0:6580:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782224109.719565:0:6580:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96ea8341a800 from lustre-OST0000 10000000:01000000:3.0:1782224109.719594:0:6580:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1782224109.719596:0:6580:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782224109.719604:0:6580:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96ea833bcd40 local copy 10000000:01000000:3.0:1782224109.719608:0:6580:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782224109.719842:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b1646e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.719853:0:6580:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b1646e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.719882:0:6580:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b1646e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224109.719900:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332952960:0@lo:101: 00000100:00100000:3.0:1782224109.719940:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224109.720001:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832ed540 going to sleep for 11 seconds 00000100:00100000:0.0:1782224109.720229:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332952960 00000100:00100000:0.0:1782224109.720237:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332952960 00000100:00100000:0.0:1782224109.720325:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782224109.720333:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+9:6580:x1868797332952960:12345-0@lo:101: 00010000:00010000:0.0:1782224109.720354:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224109.720369:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea80030400/0xcfd8b3ae4b1646ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1646e8 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224109.720392:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea80030400/0xcfd8b3ae4b1646ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1646e8 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224109.720403:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea80030400/0xcfd8b3ae4b1646ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1646e8 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224109.720411:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea80030400, rc 0) 00000100:00100000:0.0:1782224109.720461:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+10:6580:x1868797332952960:12345-0@lo:101: Request processed in 128us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224109.720467:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782224109.720543:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332952960:0@lo:101: 00010000:00010000:3.0:1782224109.720556:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b1646e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcfd8b3ae4b1646ef expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.720565:0:6580:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b1646e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcfd8b3ae4b1646ef expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224109.720684:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332953088:0@lo:501: 00000100:00100000:3.0:1782224109.723872:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224109.734178:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832ed540 going to sleep for 11 seconds 00000100:00100000:1.0:1782224109.734342:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332953088 00000100:00100000:1.0:1782224109.734354:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332953088 00000100:00100000:1.0:1782224109.734422:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782224109.734433:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+10:6580:x1868797332953088:12345-0@lo:501: 00000100:00100000:1.0:1782224109.735179:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+10:6580:x1868797332953088:12345-0@lo:501: Request processed in 745us (11314us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782224109.735188:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782224109.735363:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332953088:0@lo:501: 10000000:01000000:3.0:1782224109.735388:0:6580:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.107@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782224109.735427:0:6580:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.107@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782224109.735436:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b1646e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcfd8b3ae4b1646ef expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.735446:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b1646e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcfd8b3ae4b1646ef expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.735454:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b1646e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcfd8b3ae4b1646ef expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.735493:0:6580:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782224109.735531:0:6580:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96ea8341a800 10000000:01000000:3.0:1782224109.735537:0:6580:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782224109.735541:0:6580:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff96ea833bcd40 10000000:01000000:3.0:1782224109.735544:0:6580:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1782224109.735547:0:6580:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff96ea833bcd40 from 1 10000000:01000000:3.0:1782224109.735550:0:6580:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782224109.735580:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb710400/0xcfd8b3ae4b1646f6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.735589:0:6580:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabb710400/0xcfd8b3ae4b1646f6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.735598:0:6580:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabb710400/0xcfd8b3ae4b1646f6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224109.735626:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332953216:0@lo:101: 00000100:00100000:3.0:1782224109.735664:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224109.735690:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832ed180 going to sleep for 11 seconds 00000100:00100000:0.0:1782224109.736079:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332953216 00000100:00100000:0.0:1782224109.736086:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332953216 00000100:00100000:0.0:1782224109.736130:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782224109.736139:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+10:6580:x1868797332953216:12345-0@lo:101: 00010000:00010000:0.0:1782224109.736150:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224109.736164:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea80030a00/0xcfd8b3ae4b1646fd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1646f6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224109.736187:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea80030a00/0xcfd8b3ae4b1646fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1646f6 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224109.736209:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea80030a00/0xcfd8b3ae4b1646fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1646f6 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224109.736218:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea80030a00, rc 0) 00000100:00100000:0.0:1782224109.736267:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+11:6580:x1868797332953216:12345-0@lo:101: Request processed in 129us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224109.736274:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1782224109.736491:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224109.736497:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b1646e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcfd8b3ae4b1646ef expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.736505:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabb711600 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:1.0:1782224109.736509:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b1646e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcfd8b3ae4b1646ef expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.736517:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b1646e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xcfd8b3ae4b1646ef expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224109.736536:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b1646e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xcfd8b3ae4b1646ef expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224109.736542:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782224109.736565:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b1646e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcfd8b3ae4b1646ef expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.736571:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782224109.736595:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b1646e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcfd8b3ae4b1646ef expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.736601:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b1646e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcfd8b3ae4b1646ef expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224109.736818:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782224109.736833:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332953344:0@lo:103: 00000100:00100000:2.0:1782224109.736873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224109.740252:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332953344 00000100:00100000:2.0:1782224109.740266:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332953344 00000100:00100000:2.0:1782224109.740346:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782224109.740355:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf236300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+11:3305:x1868797332953344:12345-0@lo:103: 00010000:00010000:2.0:1782224109.740372:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224109.740390:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea80030400/0xcfd8b3ae4b1646ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfd8b3ae4b1646e8 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.740413:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224109.740480:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf236300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+10:3305:x1868797332953344:12345-0@lo:103: Request processed in 128us (3607us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224109.740487:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1782224109.740775:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224109.740778:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224109.740780:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224109.741190:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332953344:0@lo:103: 00000100:00100000:3.0:1782224109.741313:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332953216:0@lo:101: 00010000:00010000:3.0:1782224109.741334:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabb710400/0xcfd8b3ae4b1646f6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1646fd expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.741345:0:6580:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabb710400/0xcfd8b3ae4b1646f6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b1646fd expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224109.741363:0:6580:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782224109.741376:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb710400/0xcfd8b3ae4b1646f6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1646fd expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.741401:0:6580:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabb710400/0xcfd8b3ae4b1646f6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1646fd expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224109.741411:0:6580:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782224109.741416:0:6580:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782224109.741423:0:6580:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1782224109.741425:0:6580:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782224109.741458:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb711a00/0xcfd8b3ae4b164704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.741465:0:6580:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabb711a00/0xcfd8b3ae4b164704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.741473:0:6580:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabb711a00/0xcfd8b3ae4b164704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224109.741490:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332953472:0@lo:101: 00000100:00100000:3.0:1782224109.741857:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224109.741894:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832ed180 going to sleep for 11 seconds 00000100:00100000:0.0:1782224109.742005:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332953472 00000100:00100000:0.0:1782224109.742011:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332953472 00000100:00100000:0.0:1782224109.742068:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782224109.742075:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+10:6580:x1868797332953472:12345-0@lo:101: 00010000:00010000:0.0:1782224109.742088:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224109.742101:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea80030c00/0xcfd8b3ae4b16470b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b164704 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224109.742229:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea80030c00/0xcfd8b3ae4b16470b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164704 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224109.742239:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea80030c00/0xcfd8b3ae4b16470b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164704 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224109.742248:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea80030c00, rc 0) 00000100:00100000:0.0:1782224109.742295:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+11:6580:x1868797332953472:12345-0@lo:101: Request processed in 220us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224109.742301:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782224109.742686:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332953472:0@lo:101: 00010000:00010000:3.0:1782224109.742700:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabb711a00/0xcfd8b3ae4b164704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16470b expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.742709:0:6580:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabb711a00/0xcfd8b3ae4b164704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b16470b expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224109.742877:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332953600:0@lo:501: 00000100:00100000:3.0:1782224109.742919:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224109.742979:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832ed180 going to sleep for 11 seconds 00000100:00100000:1.0:1782224109.746805:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332953600 00000100:00100000:1.0:1782224109.746820:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332953600 00000100:00100000:2.0:1782224109.747010:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782224109.747045:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+11:6580:x1868797332953600:12345-0@lo:501: 00000100:00100000:2.0:1782224109.747410:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+11:6580:x1868797332953600:12345-0@lo:501: Request processed in 365us (4488us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224109.747419:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782224109.747682:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332953600:0@lo:501: 00000100:00100000:3.0:1782224109.747752:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332953728:0@lo:503: 00000100:00100000:3.0:1782224109.747802:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224109.747844:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832ed180 going to sleep for 11 seconds 00000100:00100000:2.0:1782224109.748054:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332953728 00000100:00100000:2.0:1782224109.748060:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332953728 00000100:00100000:2.0:1782224109.748094:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782224109.748123:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+11:6580:x1868797332953728:12345-0@lo:503: 00000100:00100000:2.0:1782224109.748299:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+11:6580:x1868797332953728:12345-0@lo:503: Request processed in 178us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224109.748307:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782224109.748651:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332953728:0@lo:503: 00000040:00080000:3.0:1782224109.749789:0:6580:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782224109.749891:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332953856:0@lo:502: 00000100:00100000:3.0:1782224109.749962:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224109.750075:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832ed180 going to sleep for 11 seconds 00000100:00100000:2.0:1782224109.753185:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332953856 00000100:00100000:2.0:1782224109.753212:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332953856 00000100:00100000:2.0:1782224109.753288:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782224109.753298:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+11:6580:x1868797332953856:12345-0@lo:502: 00000100:00100000:3.0:1782224109.754350:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332953856:0@lo:502: 00000100:00100000:2.0:1782224109.755076:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+11:6580:x1868797332953856:12345-0@lo:502: Request processed in 1319us (4653us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224109.755090:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000040:00080000:3.0:1782224109.755396:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782224109.755469:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1782224109.755505:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1782224109.755649:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1782224109.755690:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1782224109.755859:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1782224109.755906:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332953984:0@lo:502: 00000100:00100000:3.0:1782224109.755971:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224109.756098:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832ed180 going to sleep for 11 seconds 00000100:00100000:1.0:1782224109.762272:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332953984 00000100:00100000:1.0:1782224109.762290:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332953984 00000100:00100000:1.0:1782224109.762368:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782224109.762379:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+11:6580:x1868797332953984:12345-0@lo:502: 00000100:00100000:1.0:1782224109.762890:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+11:6580:x1868797332953984:12345-0@lo:502: Request processed in 510us (6917us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224109.762899:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782224109.763319:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332953984:0@lo:502: 00000040:00080000:2.0:1782224109.763502:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1782224109.763519:0:6580:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1782224109.768472:0:6598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782224109.768486:0:6598:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1782224109.768494:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224109.768496:0:6598:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1782224109.768503:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782224109.768531:0:6598:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff96ea83ecb380) 00000020:00000080:3.0:1782224109.768568:0:6598:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1782224109.768576:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782224109.768645:0:6598:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96ea8341a800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1782224109.768654:0:6598:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782224109.768661:0:6598:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcfd8b3ae4b164719 00010000:00010000:3.0:1782224109.781302:0:6598:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1782224109.782001:0:6598:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1782224109.802287:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1782224109.802672:0:6598:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1782224109.809596:0:6598:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1782224109.810561:0:6598:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1782224109.812174:0:6598:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1782224109.812186:0:6598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782224109.812193:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224109.812208:0:6598:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1782224109.812212:0:6598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782224109.812216:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224109.812218:0:6598:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782224109.812220:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782224109.812222:0:6598:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1782224109.812277:0:6598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782224109.812281:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224109.812282:0:6598:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782224109.812285:0:6598:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1782224109.812515:0:6580:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1782224109.812549:0:6580:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1782224109.812578:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb711a00/0xcfd8b3ae4b164704 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16470b expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.812591:0:6580:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabb711a00/0xcfd8b3ae4b164704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16470b expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224109.812600:0:6580:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96ea8341a800 from 1 10000000:01000000:2.0:1782224109.812603:0:6580:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782224109.812641:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b164720 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.812649:0:6580:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b164720 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.812670:0:6580:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b164720 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224109.812695:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf235180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332954112:0@lo:101: 00000100:00100000:2.0:1782224109.812770:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224109.812810:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905f2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782224109.812891:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332954112 00000100:00100000:0.0:1782224109.812899:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332954112 00000100:00100000:0.0:1782224109.812952:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782224109.812962:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+11:6580:x1868797332954112:12345-0@lo:101: 00010000:00010000:0.0:1782224109.812976:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224109.812990:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea80031c00/0xcfd8b3ae4b164727 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b164720 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224109.813056:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea80031c00/0xcfd8b3ae4b164727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164720 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224109.813067:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea80031c00/0xcfd8b3ae4b164727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164720 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224109.813076:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea80031c00, rc 0) 00000100:00100000:0.0:1782224109.813293:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+12:6580:x1868797332954112:12345-0@lo:101: Request processed in 332us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224109.813301:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782224109.813388:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf235180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332954112:0@lo:101: 00010000:00010000:2.0:1782224109.813403:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b164720 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164727 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.813412:0:6580:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b164720 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164727 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224109.813508:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf235180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332954240:0@lo:501: 00000100:00100000:2.0:1782224109.813538:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224109.813569:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905f2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782224109.813706:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332954240 00000100:00100000:0.0:1782224109.813711:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332954240 00000100:00100000:0.0:1782224109.813742:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782224109.813750:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:6580:x1868797332954240:12345-0@lo:501: 00000100:00100000:0.0:1782224109.813986:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:6580:x1868797332954240:12345-0@lo:501: Request processed in 236us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224109.813993:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782224109.814247:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf235180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332954240:0@lo:501: 00000100:00100000:3.0:1782224109.814279:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332954368:0@lo:503: 00000100:00100000:3.0:1782224109.814323:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224109.814351:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832ed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224109.814418:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332954368 00000100:00100000:0.0:1782224109.814423:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332954368 00000100:00100000:0.0:1782224109.814456:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782224109.814464:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+12:6580:x1868797332954368:12345-0@lo:503: 00000100:00100000:0.0:1782224109.814701:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+12:6580:x1868797332954368:12345-0@lo:503: Request processed in 237us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224109.814708:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782224109.814863:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332954368:0@lo:503: 00000040:00080000:2.0:1782224109.815286:0:6580:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782224109.815347:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf235500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332954496:0@lo:502: 00000100:00100000:2.0:1782224109.815394:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224109.815419:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905f2600 going to sleep for 11 seconds 00000100:00100000:3.0:1782224109.815512:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332954496 00000100:00100000:3.0:1782224109.815518:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332954496 00000100:00100000:3.0:1782224109.815551:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782224109.815568:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+12:6580:x1868797332954496:12345-0@lo:502: 00000100:00100000:3.0:1782224109.815738:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+12:6580:x1868797332954496:12345-0@lo:502: Request processed in 171us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224109.815746:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782224109.815944:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf235500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332954496:0@lo:502: 00000040:00080000:2.0:1782224109.816360:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1782224109.816409:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1782224109.816435:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf235500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332954624:0@lo:502: 00000100:00100000:2.0:1782224109.816484:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224109.816548:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905f2600 going to sleep for 11 seconds 00000100:00100000:3.0:1782224109.821477:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332954624 00000100:00100000:3.0:1782224109.821494:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332954624 00000100:00100000:3.0:1782224109.822143:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782224109.822156:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:6580:x1868797332954624:12345-0@lo:502: 00000100:00100000:3.0:1782224109.822454:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:6580:x1868797332954624:12345-0@lo:502: Request processed in 300us (5968us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224109.822463:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782224109.823347:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf235500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332954624:0@lo:502: 00000040:00080000:2.0:1782224109.823533:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1782224109.823550:0:6580:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1782224109.824861:0:6602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782224109.824874:0:6602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224109.824876:0:6602:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782224109.824883:0:6602:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96ea8341a800 00000020:00000080:2.0:1782224109.824885:0:6602:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782224109.824904:0:6602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782224109.824907:0:6602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224109.824908:0:6602:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1782224109.824911:0:6602:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1782224109.825232:0:6580:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1782224109.825257:0:6580:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782224109.825283:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b164720 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164727 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.825296:0:6580:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b164720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164727 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224109.825340:0:6580:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782224109.825342:0:6580:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96ea8341a800 10000000:01000000:3.0:1782224109.825346:0:6580:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96ea8341a800 10000000:01000000:3.0:1782224109.825350:0:6580:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782224109.825355:0:6580:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff96ea8341a800 from 1 10000000:01000000:3.0:1782224109.825358:0:6580:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782224109.825395:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b16472e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.825404:0:6580:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b16472e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.825427:0:6580:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b16472e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224109.825452:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332954752:0@lo:101: 00000100:00100000:3.0:1782224109.825520:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224109.825556:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832ed240 going to sleep for 11 seconds 00000100:00100000:2.0:1782224109.825647:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332954752 00000100:00100000:2.0:1782224109.825656:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332954752 00000100:00100000:2.0:1782224109.825703:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782224109.825713:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+12:6580:x1868797332954752:12345-0@lo:101: 00010000:00010000:2.0:1782224109.825728:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224109.825742:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabb611600/0xcfd8b3ae4b164735 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b16472e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.825765:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabb611600/0xcfd8b3ae4b164735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16472e expref: 13 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.825776:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabb611600/0xcfd8b3ae4b164735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16472e expref: 13 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.825785:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabb611600, rc 0) 00000100:00100000:2.0:1782224109.825838:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+13:6580:x1868797332954752:12345-0@lo:101: Request processed in 127us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224109.825852:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782224109.825994:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332954752:0@lo:101: 00010000:00010000:1.0:1782224109.826011:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b16472e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164735 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.826056:0:6580:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b16472e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164735 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224109.826162:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332954880:0@lo:501: 00000100:00100000:1.0:1782224109.826218:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224109.826242:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea89171000 going to sleep for 11 seconds 00000100:00100000:2.0:1782224109.826580:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332954880 00000100:00100000:2.0:1782224109.826586:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332954880 00000100:00100000:2.0:1782224109.826620:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782224109.826628:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+13:6580:x1868797332954880:12345-0@lo:501: 00000100:00100000:2.0:1782224109.826872:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+13:6580:x1868797332954880:12345-0@lo:501: Request processed in 244us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224109.826880:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782224109.826963:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332954880:0@lo:501: 00000100:00100000:1.0:1782224109.827002:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332955008:0@lo:503: 00000100:00100000:1.0:1782224109.827074:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224109.827178:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea89171000 going to sleep for 11 seconds 00000100:00100000:1.0:1782224109.827207:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332955008 00000100:00100000:1.0:1782224109.827212:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332955008 00000100:00100000:1.0:1782224109.827236:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782224109.827243:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+13:6580:x1868797332955008:12345-0@lo:503: 00000100:00100000:1.0:1782224109.827396:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+13:6580:x1868797332955008:12345-0@lo:503: Request processed in 153us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224109.827403:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782224109.827441:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332955008:0@lo:503: 00000040:00080000:1.0:1782224109.827747:0:6580:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782224109.827829:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332955136:0@lo:502: 00000100:00100000:1.0:1782224109.827866:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224109.827884:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea89171000 going to sleep for 11 seconds 00000100:00100000:1.0:1782224109.827899:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332955136 00000100:00100000:1.0:1782224109.827903:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332955136 00000100:00100000:1.0:1782224109.827922:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782224109.827929:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+13:6580:x1868797332955136:12345-0@lo:502: 00000100:00100000:1.0:1782224109.828602:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+13:6580:x1868797332955136:12345-0@lo:502: Request processed in 671us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224109.828611:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782224109.829579:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332955136:0@lo:502: 00000040:00080000:2.0:1782224109.829975:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1782224109.830293:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1782224109.830333:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1782224109.830398:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1782224109.830452:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1782224109.830504:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1782224109.830541:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1782224109.830574:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1782224109.830772:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1782224109.830815:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1782224109.830849:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1782224109.830896:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1782224109.830930:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1782224109.830960:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1782224109.830999:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1782224109.831301:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1782224109.831338:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1782224109.831404:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1782224109.831445:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1782224109.831479:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1782224109.831547:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1782224109.831585:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1782224109.833230:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1782224109.833378:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1782224109.833417:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1782224109.833451:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1782224109.833501:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1782224109.833541:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1782224109.833597:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf235500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332955264:0@lo:502: 00000100:00100000:2.0:1782224109.833696:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224109.833746:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905f2240 going to sleep for 11 seconds 00000100:00100000:3.0:1782224109.833877:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332955264 00000100:00100000:3.0:1782224109.833885:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332955264 00000100:00100000:3.0:1782224109.833944:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782224109.833953:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:6580:x1868797332955264:12345-0@lo:502: 00000100:00100000:3.0:1782224109.834222:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:6580:x1868797332955264:12345-0@lo:502: Request processed in 269us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224109.834230:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782224109.834392:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf235500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332955264:0@lo:502: 00000040:00080000:1.0:1782224109.834479:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1782224109.834492:0:6580:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1782224109.836581:0:6603:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1782224109.836599:0:6603:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff96ea90cb3380) 00000020:00000080:1.0:1782224109.836633:0:6603:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1782224109.836853:0:6603:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96ea8341a800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782224109.836869:0:6603:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96ea8341a800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782224109.836871:0:6603:0:(obd_mount.c:701:lustre_put_lsi()) put ffff96ea8341a800 3 00010000:00080000:1.0:1782224109.836902:0:6603:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96e985539800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.107@tcp at head 00010000:00010000:1.0:1782224109.838592:0:6603:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1782224109.838715:0:6603:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1782224109.838754:0:6603:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782224109.838767:0:6603:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcfd8b3ae4b164743 00000100:00080000:1.0:1782224109.838780:0:6603:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782224109.838786:0:6603:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96e985539800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:1.0:1782224109.838826:0:6603:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96ea83f51c00 x1868797332955392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782224109.838869:0:6603:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1782224109.838958:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332955520:0@lo:400: 00000100:00100000:1.0:1782224109.839073:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224109.839135:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332955520 00000100:00100000:1.0:1782224109.839142:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332955520 00000100:00100000:1.0:1782224109.839188:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782224109.839347:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1868797332955392:0@lo:38: 00000100:00100000:0.0:1782224109.839386:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224109.841748:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1782224109.841764:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1782224109.844084:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1782224109.844102:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332955392 00000100:00100000:2.0:1782224109.844112:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332955392 00000100:00100000:2.0:1782224109.844143:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1782224109.844155:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782224109.844163:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1868797332955392:12345-0@lo:38: 00010000:00080000:2.0:1782224109.844191:0:5787:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1782224109.844246:0:5787:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcfd8b3ae4b16474a 00000004:00100000:2.0:1782224109.844264:0:5787:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782224109.844301:0:5787:0:(import.c:65:import_set_state_nolock()) ffff96e984e3c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782224109.844400:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1868797332955392:12345-0@lo:38: Request processed in 236us (5012us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224109.844409:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782224109.844462:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96ea83f51c00 x1868797332955392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782224119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224109.844473:0:3302:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782224109.844481:0:3302:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1782224109.844488:0:3302:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782224109.844499:0:3302:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782224109.844502:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96e985539800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782224109.844508:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1868797332955392:0@lo:38: 00000100:00100000:1.0:1782224109.845035:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332955520:12345-0@lo:400: 00000100:00100000:1.0:1782224109.845092:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332955520:12345-0@lo:400: Request processed in 5896us (6020us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224109.845301:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782224109.845349:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96ea83f52a00 x1868797332955520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224109.845362:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332955520:0@lo:400: 00000040:00080000:3.0:1782224109.848596:0:6603:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1782224109.849335:0:6580:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1782224109.849364:0:6580:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782224109.849391:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b16472e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164735 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.849404:0:6580:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b16472e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164735 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782224109.849462:0:6580:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782224109.849465:0:6580:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782224109.849466:0:6580:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782224109.849467:0:6580:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782224109.849468:0:6580:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782224109.849470:0:6580:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782224109.849472:0:6580:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782224109.849474:0:6580:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782224109.849475:0:6580:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782224109.849477:0:6580:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782224109.849479:0:6580:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782224109.849482:0:6580:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1782224109.849485:0:6580:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782224109.849487:0:6580:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782224109.849488:0:6580:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782224109.849489:0:6580:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782224109.849490:0:6580:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782224109.849491:0:6580:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782224109.849492:0:6580:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782224109.849493:0:6580:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782224109.849494:0:6580:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782224109.849495:0:6580:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782224109.849496:0:6580:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782224109.849523:0:6580:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782224109.849549:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf236680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332955648:0@lo:253: 00000100:00100000:2.0:1782224109.849622:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224109.849741:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905f2240 going to sleep for 11 seconds 00000100:00100000:3.0:1782224109.850500:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332955648 00000100:00100000:3.0:1782224109.850510:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332955648 00000100:00100000:2.0:1782224109.850614:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782224109.850623:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+13:6580:x1868797332955648:12345-0@lo:253: 20000000:01000000:2.0:1782224109.850661:0:5781:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1782224109.850674:0:5781:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1782224109.904262:0:5781:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782224109.904278:0:5781:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1782224109.904302:0:5802:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782224109.904322:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782224109.904344:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164751 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.904364:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96eabb611e00/0xcfd8b3ae4b1646b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1646a9 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.904374:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164751 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.904419:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96eabb611e00/0xcfd8b3ae4b1646b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b1646a9 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.904436:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96eabb611e00/0xcfd8b3ae4b1646b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1646a9 expref: 13 pid: 5779 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224109.904451:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5802:1868797332955776:0@lo:104: 00000100:00100000:1.0:1782224109.904530:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224109.908564:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332955776 00000100:00100000:0.0:1782224109.908580:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332955776 00000100:00100000:0.0:1782224109.908657:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782224109.908668:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+3:5802:x1868797332955776:12345-0@lo:104: 00010000:00010000:0.0:1782224109.908688:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96ea99876800/0xcfd8b3ae4b1646a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1646b0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224109.908800:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782224109.908807:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+3:5802:x1868797332955776:12345-0@lo:104: Request processed in 141us (4277us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224109.908814:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1782224109.909179:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782224109.909187:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea99876800/0xcfd8b3ae4b1646a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1646b0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.909203:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876800 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:2.0:1782224109.909207:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea99876800/0xcfd8b3ae4b1646a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b1646b0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.909217:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea99876800/0xcfd8b3ae4b1646a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b1646b0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782224109.909225:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea99876800/0xcfd8b3ae4b1646a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b1646b0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224109.909231:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782224109.909282:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96ea99876800/0xcfd8b3ae4b1646a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1646b0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.909289:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782224109.909309:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea99876800/0xcfd8b3ae4b1646a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1646b0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.909317:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea99876800/0xcfd8b3ae4b1646a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1646b0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224109.909352:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224109.909354:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224109.909355:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224109.912551:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782224109.912585:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797332955904:0@lo:103: 00000100:00100000:0.0:1782224109.912681:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224109.912782:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332955904 00000100:00100000:3.0:1782224109.912790:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332955904 00010000:00010000:3.0:1782224109.912827:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96eabb611e00/0xcfd8b3ae4b1646b0 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1646a9 expref: 14 pid: 5779 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224109.912858:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782224109.912867:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea860b0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b33607d9-62cb-4729-8187-59883763158a+14:3303:x1868797332955904:12345-0@lo:103: 00010000:00010000:3.0:1782224109.912882:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224109.912888:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96eabb611e00/0xcfd8b3ae4b1646b0 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1646a9 expref: 14 pid: 5779 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.912899:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96eabb611e00/0xcfd8b3ae4b1646b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1646a9 expref: 14 pid: 5779 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.912941:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164751 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.912950:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164751 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782224109.912969:0:5771:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008647057s 00010000:00010000:3.0:1782224109.912974:0:5771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164751 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.912982:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164751 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.912989:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164751 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.912996:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164751 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.913002:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876c00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224109.913007:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164751 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.913055:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164751 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.913066:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164751 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224109.913076:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224109.913113:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea860b0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b33607d9-62cb-4729-8187-59883763158a+14:3303:x1868797332955904:12345-0@lo:103: Request processed in 246us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224109.913126:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782224109.918304:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea89171000 going to sleep for 11 seconds 00010000:00010000:1.0:1782224109.918349:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabb611e00/0xcfd8b3ae4b1646b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b1646a9 expref: 13 pid: 5779 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224109.918367:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5802:1868797332955776:0@lo:104: 00010000:00010000:1.0:1782224109.918390:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164751 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.918400:0:5802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164751 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.918406:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164751 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224109.918432:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164751 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224109.919520:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+12:6580:x1868797332955648:12345-0@lo:253: Request processed in 68892us (69892us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224109.919533:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782224109.919635:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf236680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:6580:1868797332955648:0@lo:253: 10000000:01000000:1.0:1782224109.919650:0:6580:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1782224109.919654:0:6580:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782224109.919656:0:6580:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782224109.919657:0:6580:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782224109.919658:0:6580:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782224109.919660:0:6580:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782224109.919661:0:6580:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782224109.919663:0:6580:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782224109.919665:0:6580:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782224109.919666:0:6580:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782224109.919667:0:6580:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782224109.919669:0:6580:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782224109.919685:0:6580:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1782224109.924311:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797332955904:0@lo:103: 00080000:10000000:1.0:1782224109.933613:0:6580:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1782224109.934261:0:6580:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1782224109.934494:0:6580:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1782224109.935934:0:6580:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1782224109.936883:0:6580:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1782224109.937480:0:6580:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1782224109.939175:0:6580:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1782224110.230578:0:6580:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1782224110.230587:0:6580:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1782224110.230637:0:6580:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782224110.230715:0:6580:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.107@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782224110.230733:0:6580:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1782224110.230766:0:6580:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1782224110.292283:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224111.316175:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782224112.218336:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782224112.218362:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff96ea982ae000 from 21 10000000:01000000:1.0:1782224112.218369:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782224112.218416:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea99876200/0xcfd8b3ae4b164758 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224112.218429:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea99876200/0xcfd8b3ae4b164758 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224112.219185:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea99876200/0xcfd8b3ae4b164758 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224112.219215:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332956032:0@lo:101: 00000100:00100000:1.0:1782224112.219288:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224112.219446:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabfca5840 going to sleep for 11 seconds 00000100:00100000:0.0:1782224112.224289:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332956032 00000100:00100000:0.0:1782224112.224304:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332956032 00000100:00100000:1.0:1782224112.227293:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782224112.227308:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+12:5783:x1868797332956032:12345-0@lo:101: 00010000:00010000:1.0:1782224112.227327:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224112.227348:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b16475f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b164758 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224112.227380:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b16475f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164758 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224112.227393:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b16475f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164758 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224112.227403:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99877a00, rc 0) 00000100:00100000:1.0:1782224112.227504:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+13:5783:x1868797332956032:12345-0@lo:101: Request processed in 199us (8215us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224112.227511:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782224112.227629:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332956032:0@lo:101: 00010000:00010000:2.0:1782224112.227649:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea99876200/0xcfd8b3ae4b164758 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16475f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224112.227673:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea99876200/0xcfd8b3ae4b164758 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b16475f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224112.227756:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf234380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332956160:0@lo:501: 00000100:00100000:2.0:1782224112.227792:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224112.229211:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea82eca840 going to sleep for 11 seconds 00000100:00100000:0.0:1782224112.229316:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332956160 00000100:00100000:0.0:1782224112.229324:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332956160 00000100:00100000:0.0:1782224112.229370:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782224112.229378:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:5783:x1868797332956160:12345-0@lo:501: 00000100:00100000:0.0:1782224112.233964:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:5783:x1868797332956160:12345-0@lo:501: Request processed in 4577us (6162us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224112.233978:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782224112.234125:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf234380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332956160:0@lo:501: 00000100:00100000:0.0:1782224112.234211:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332956288:0@lo:503: 00000100:00100000:0.0:1782224112.234254:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224112.234277:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabd0d4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782224112.234290:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332956288 00000100:00100000:0.0:1782224112.234295:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332956288 00000100:00100000:0.0:1782224112.234322:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782224112.234328:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:5783:x1868797332956288:12345-0@lo:503: 00000100:00100000:0.0:1782224112.235925:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:5783:x1868797332956288:12345-0@lo:503: Request processed in 1590us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224112.235934:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782224112.235997:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332956288:0@lo:503: 00000100:00100000:0.0:1782224112.236220:0:6691:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0fad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:6691:1868797332956416:0@lo:502: 00000100:00100000:0.0:1782224112.236256:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224112.236278:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332956416 00000100:00100000:0.0:1782224112.236281:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332956416 00000100:00100000:0.0:1782224112.236302:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782224112.236306:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:6691:x1868797332956416:12345-0@lo:502: 00000100:00100000:0.0:1782224112.236505:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:6691:x1868797332956416:12345-0@lo:502: Request processed in 196us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224112.236512:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782224112.236552:0:6691:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabd0d4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782224112.236563:0:6691:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0fad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:6691:1868797332956416:0@lo:502: 00000100:00100000:0.0:1782224112.236601:0:6691:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0fad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:6691:1868797332956544:0@lo:502: 00000100:00100000:0.0:1782224112.236632:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224112.236655:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332956544 00000100:00100000:0.0:1782224112.236665:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332956544 00000100:00100000:0.0:1782224112.236681:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782224112.238079:0:6691:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabd0d4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782224112.238119:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:6691:x1868797332956544:12345-0@lo:502: 00000100:00100000:0.0:1782224112.238673:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:6691:x1868797332956544:12345-0@lo:502: Request processed in 1985us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224112.238683:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782224112.245156:0:6691:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0fad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:6691:1868797332956544:0@lo:502: 00000040:00080000:1.0:1782224112.246630:0:6691:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1782224112.251216:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1782224112.251260:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782224112.251274:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea99876200/0xcfd8b3ae4b164758 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16475f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224112.251287:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea99876200/0xcfd8b3ae4b164758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16475f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224112.251298:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782224112.251301:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff96ea982ae000 from 4 10000000:01000000:2.0:1782224112.251313:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782224112.251359:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb611000/0xcfd8b3ae4b164766 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224112.251366:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabb611000/0xcfd8b3ae4b164766 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224112.251378:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabb611000/0xcfd8b3ae4b164766 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224112.251401:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf237100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332956672:0@lo:101: 00000100:00100000:2.0:1782224112.254520:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224112.254620:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea89126300 going to sleep for 11 seconds 00000100:00100000:1.0:1782224112.264415:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332956672 00000100:00100000:1.0:1782224112.264431:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332956672 00000100:00100000:0.0:1782224112.264625:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782224112.264637:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+13:5783:x1868797332956672:12345-0@lo:101: 00010000:00010000:0.0:1782224112.264655:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224112.264677:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea80031600/0xcfd8b3ae4b16476d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b164766 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224112.264718:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea80031600/0xcfd8b3ae4b16476d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164766 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224112.264730:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea80031600/0xcfd8b3ae4b16476d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164766 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224112.264740:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea80031600, rc 0) 00000100:00100000:0.0:1782224112.264825:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+14:5783:x1868797332956672:12345-0@lo:101: Request processed in 191us (10313us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224112.264833:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782224112.264877:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf237100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332956672:0@lo:101: 00010000:00010000:0.0:1782224112.264896:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabb611000/0xcfd8b3ae4b164766 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16476d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224112.264906:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabb611000/0xcfd8b3ae4b164766 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b16476d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224112.264987:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332956800:0@lo:256: 00000100:00100000:0.0:1782224112.265048:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224112.265078:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabd0d4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782224112.265094:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332956800 00000100:00100000:0.0:1782224112.265098:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332956800 00000100:00100000:0.0:1782224112.265115:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782224112.265121:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+14:5783:x1868797332956800:12345-0@lo:256: 20000000:01000000:0.0:1782224112.265135:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782224112.265153:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782224112.265156:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1782224112.265263:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+14:5783:x1868797332956800:12345-0@lo:256: Request processed in 140us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224112.265271:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782224112.265293:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332956800:0@lo:256: 10000000:01000000:0.0:1782224112.265338:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782224112.265345:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb611000/0xcfd8b3ae4b164766 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16476d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224112.265353:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabb611000/0xcfd8b3ae4b164766 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16476d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782224112.265362:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1782224112.265365:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1782224112.265368:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782224112.265390:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea80030400/0xcfd8b3ae4b164774 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224112.265407:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea80030400/0xcfd8b3ae4b164774 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224112.265415:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea80030400/0xcfd8b3ae4b164774 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224112.265428:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332956928:0@lo:101: 00000100:00100000:0.0:1782224112.265465:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224112.265475:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabd0d4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782224112.265492:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332956928 00000100:00100000:0.0:1782224112.265495:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332956928 00000100:00100000:0.0:1782224112.265512:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782224112.265518:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+14:5783:x1868797332956928:12345-0@lo:101: 00010000:00010000:0.0:1782224112.265524:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224112.265534:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea80031a00/0xcfd8b3ae4b16477b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b164774 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224112.265548:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea80031a00/0xcfd8b3ae4b16477b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164774 expref: 15 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224112.265557:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea80031a00/0xcfd8b3ae4b16477b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164774 expref: 15 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224112.265564:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea80031a00, rc 0) 00000100:00100000:0.0:1782224112.265593:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:5783:x1868797332956928:12345-0@lo:101: Request processed in 75us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224112.265599:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782224112.265619:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332956928:0@lo:101: 00010000:00010000:0.0:1782224112.265636:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea80030400/0xcfd8b3ae4b164774 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16477b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224112.265644:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea80030400/0xcfd8b3ae4b164774 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b16477b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224112.265689:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332957056:0@lo:501: 00000100:00100000:0.0:1782224112.265714:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224112.265723:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabd0d4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782224112.265737:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332957056 00000100:00100000:0.0:1782224112.265741:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332957056 00000100:00100000:0.0:1782224112.265756:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782224112.265762:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:5783:x1868797332957056:12345-0@lo:501: 00000100:00100000:0.0:1782224112.266066:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:5783:x1868797332957056:12345-0@lo:501: Request processed in 303us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224112.266073:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782224112.266093:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332957056:0@lo:501: 00000100:00100000:0.0:1782224112.266119:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332957184:0@lo:503: 00000100:00100000:0.0:1782224112.266156:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224112.266166:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabd0d4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782224112.266195:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332957184 00000100:00100000:0.0:1782224112.266199:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332957184 00000100:00100000:0.0:1782224112.266215:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782224112.266221:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:5783:x1868797332957184:12345-0@lo:503: 00000100:00100000:0.0:1782224112.266505:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:5783:x1868797332957184:12345-0@lo:503: Request processed in 283us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224112.266512:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782224112.266545:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332957184:0@lo:503: 00000100:00100000:0.0:1782224112.266776:0:6694:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:6694:1868797332957312:0@lo:502: 00000100:00100000:0.0:1782224112.266811:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224112.266831:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332957312 00000100:00100000:0.0:1782224112.266835:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332957312 00000100:00100000:0.0:1782224112.266852:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782224112.266857:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:6694:x1868797332957312:12345-0@lo:502: 00000100:00100000:0.0:1782224112.267058:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:6694:x1868797332957312:12345-0@lo:502: Request processed in 199us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224112.267065:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782224112.267093:0:6694:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabd0d4840 going to sleep for 11 seconds 00000100:00100000:0.0:1782224112.267104:0:6694:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:6694:1868797332957312:0@lo:502: 00000020:01000000:0.0:1782224112.267125:0:6694:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782224112.267133:0:6694:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1782224112.267140:0:6694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224112.267142:0:6694:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1782224112.267147:0:6694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1782224112.267151:0:6694:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.107@tcp to nid 0x20000c0a8ca6b (192.168.202.107@tcp) 00000020:01000000:0.0:1782224112.267182:0:6694:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1782224112.267186:0:6694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782224112.267199:0:6694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff96ea833b99c0) 00000020:00000080:0.0:1782224112.267218:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1782224112.267224:0:6694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1782224112.267304:0:6694:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1782224112.267310:0:6694:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1782224112.267317:0:6694:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfd8b3ae4b164789 00010000:00080000:0.0:1782224112.267346:0:6694:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96ea9834f800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.107@tcp at head 00010000:00010000:3.0:1782224112.277956:0:6694:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1782224112.340385:0:6694:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1782224112.340419:0:6694:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1782224112.341059:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:0.0:1782224112.341162:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782224112.341251:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782224112.341300:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1782224112.341362:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1782224112.343813:0:6701:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782224112.343820:0:6701:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1782224112.344198:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782224112.344764:0:6694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782224112.344807:0:6694:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1782224112.344834:0:6694:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfd8b3ae4b164790 00000100:00080000:2.0:1782224112.344846:0:6694:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782224112.344853:0:6694:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96ea9834f800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:2.0:1782224112.344889:0:6694:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96eabf237b80 x1868797332957440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782224112.344962:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797332957440:0@lo:8: 00000100:00100000:0.0:1782224112.345356:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224112.345499:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332957440 00000100:00100000:3.0:1782224112.345508:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332957440 00000100:00100000:3.0:1782224112.345551:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782224112.345558:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1868797332957440:12345-0@lo:8: 00010000:00080000:3.0:1782224112.345585:0:6582:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:3.0:1782224112.345617:0:6582:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfd8b3ae4b164797 00002000:00100000:3.0:1782224112.346803:0:6582:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff96e9854da000 ocd_connect_flags: 0xe044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1782224112.346813:0:6582:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1782224112.346817:0:6582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1782224112.346859:0:6694:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00002000:00100000:3.0:1782224112.346955:0:6582:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:2.0:1782224112.347010:0:6694:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782224112.347036:0:6694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224112.347039:0:6694:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1782224112.347043:0:6694:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782224112.347046:0:6694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224112.347047:0:6694:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782224112.347050:0:6694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782224112.347052:0:6694:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1782224112.347092:0:6694:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf234000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:6694:1868797332957568:0@lo:502: 00002000:00080000:3.0:1782224112.347128:0:6582:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782224112.347157:0:6582:0:(import.c:65:import_set_state_nolock()) ffff96e9854d8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782224112.347193:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224112.347236:0:6694:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa7d49480 going to sleep for 11 seconds 00000100:00100000:1.0:1782224112.349331:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797332957696:0@lo:400: 00000100:00100000:1.0:1782224112.349399:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224112.349431:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782224112.349437:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797332957824:0@lo:400: 00000100:00100000:1.0:1782224112.349465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224112.349498:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332957696 00000100:00100000:1.0:1782224112.349505:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332957696 00000100:00100000:1.0:1782224112.349551:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332957824 00000100:00100000:1.0:1782224112.349553:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332957824 00000100:00100000:1.0:1782224112.349587:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782224112.349595:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797332957696:12345-0@lo:400: 00000100:00100000:1.0:1782224112.349656:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797332957696:12345-0@lo:400: Request processed in 61us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224112.349664:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782224112.349682:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224112.349699:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797332957824:12345-0@lo:400: 00000100:00100000:1.0:1782224112.349726:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797332957824:12345-0@lo:400: Request processed in 38us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224112.349732:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1782224112.349757:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782224112.349788:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96ea83f50a80 x1868797332957824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224112.349801:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797332957824:0@lo:400: 00010000:00080000:1.0:1782224112.349826:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96ea83f52a00 x1868797332957696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224112.349835:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797332957696:0@lo:400: 00000100:00100000:3.0:1782224112.351114:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1868797332957440:12345-0@lo:8: Request processed in 5548us (5752us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224112.351126:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782224112.354254:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332957568 00000100:00100000:1.0:1782224112.354269:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332957568 00000100:00100000:1.0:1782224112.354327:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782224112.354338:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:6694:x1868797332957568:12345-0@lo:502: 00000100:00100000:1.0:1782224112.354896:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:6694:x1868797332957568:12345-0@lo:502: Request processed in 558us (7700us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224112.354905:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782224112.354978:0:6694:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf234000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:6694:1868797332957568:0@lo:502: 00000020:01000000:1.0:1782224112.355033:0:6694:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782224112.355043:0:6694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224112.355045:0:6694:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782224112.355050:0:6694:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00010000:00080000:0.0:1782224112.355279:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eabf237b80 x1868797332957440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782224122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224112.355291:0:3302:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782224112.355299:0:3302:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1782224112.355308:0:3302:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xe040401443000026 00000100:00080000:0.0:1782224112.355314:0:3302:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1782224112.355317:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96ea9834f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782224112.355337:0:3302:0:(osp_dev.c:1650:osp_import_event()) got connected 00000100:00100000:0.0:1782224112.355343:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797332957440:0@lo:8: 00000020:01000000:0.0:1782224112.355365:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1782224112.355386:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782224112.355396:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea80030400/0xcfd8b3ae4b164774 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16477b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224112.355407:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea80030400/0xcfd8b3ae4b164774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16477b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782224112.355419:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1782224112.355422:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff96ea833bcd40 from 1 10000000:01000000:0.0:1782224112.355425:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782224112.355466:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea80031200/0xcfd8b3ae4b16479e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224112.355475:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea80031200/0xcfd8b3ae4b16479e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224112.355484:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea80031200/0xcfd8b3ae4b16479e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224112.355514:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332957952:0@lo:101: 00000100:00100000:0.0:1782224112.355555:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224112.355588:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea831d33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782224112.355883:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332957952 00000100:00100000:3.0:1782224112.355895:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332957952 00000100:00100000:3.0:1782224112.355926:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782224112.355935:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+15:5783:x1868797332957952:12345-0@lo:101: 00010000:00010000:3.0:1782224112.355948:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224112.355962:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabb710c00/0xcfd8b3ae4b1647a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b16479e expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224112.355985:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabb710c00/0xcfd8b3ae4b1647a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16479e expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224112.356007:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabb710c00/0xcfd8b3ae4b1647a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16479e expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224112.356032:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabb710c00, rc 0) 00000100:00100000:3.0:1782224112.356074:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+16:5783:x1868797332957952:12345-0@lo:101: Request processed in 140us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224112.356080:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:3.0:1782224112.356133:0:6701:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1782224112.356142:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332957952:0@lo:101: 00010000:00010000:0.0:1782224112.356155:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea80031200/0xcfd8b3ae4b16479e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1647a5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224112.356164:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea80031200/0xcfd8b3ae4b16479e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b1647a5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224112.356216:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332958080:0@lo:501: 00000100:00100000:0.0:1782224112.356241:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224112.356262:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea831d33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224112.356274:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332958080 00000100:00100000:0.0:1782224112.356277:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332958080 00000100:00100000:0.0:1782224112.356304:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782224112.356310:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea90c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+16:5783:x1868797332958080:12345-0@lo:501: 00000004:00080000:3.0:1782224112.356312:0:6701:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 193136296743ns, next at 0ns, rc = 0 00000100:00100000:0.0:1782224112.356507:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea90c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+16:5783:x1868797332958080:12345-0@lo:501: Request processed in 196us (264us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782224112.356514:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782224112.356546:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332958080:0@lo:501: 10000000:01000000:0.0:1782224112.356562:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782224112.356568:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea80031200/0xcfd8b3ae4b16479e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1647a5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224112.356575:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea80031200/0xcfd8b3ae4b16479e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1647a5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224112.469366:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332958208:0@lo:13: 00000100:00100000:3.0:1782224112.469471:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224112.469513:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332958208 00000100:00100000:1.0:1782224112.469523:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332958208 00000100:00100000:1.0:1782224112.469586:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782224112.469599:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1868797332958208:12345-0@lo:13: 00002000:00000024:1.0:1782224112.469640:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000004:00080000:0.0:1782224112.469956:0:6702:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1782224112.469980:0:6702:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0fa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6702:1868797332958336:0@lo:7: 00000100:00100000:0.0:1782224112.470035:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224112.470073:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332958336 00000100:00100000:0.0:1782224112.470077:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332958336 00000100:00100000:0.0:1782224112.470123:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782224112.470132:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6702:x1868797332958336:12345-0@lo:7: 00000100:00100000:1.0:1782224112.470634:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1868797332958208:12345-0@lo:13: Request processed in 1035us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224112.470644:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1782224112.470670:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782224112.471604:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eabd0f9f80 x1868797332958208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224112.471633:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332958208:0@lo:13: 00000100:00100000:1.0:1782224112.471640:0:6702:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea831d3b40 going to sleep for 11 seconds 00002000:00080000:1.0:1782224112.487260:0:6585:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1782224112.487272:0:6585:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1782224112.487840:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6702:x1868797332958336:12345-0@lo:7: Request processed in 17703us (17819us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224112.487859:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782224112.487885:0:6702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eabd0fa300 x1868797332958336/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782224128 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224112.487903:0:6702:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0fa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6702:1868797332958336:0@lo:7: 00000004:00080000:0.0:1782224112.487917:0:6702:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1782224112.487959:0:6702:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0fa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6702:1868797332958464:0@lo:5: 00000100:00100000:0.0:1782224112.487994:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224112.488061:0:6702:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea831d3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782224112.488125:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332958464 00000100:00100000:1.0:1782224112.488133:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332958464 00000100:00100000:1.0:1782224112.488198:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782224112.488207:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1782224112.488208:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6702:x1868797332958464:12345-0@lo:5: 00000100:00100000:0.0:1782224112.488220:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:1.0:1782224112.488240:0:6582:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1782224112.488246:0:6582:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1782224112.489778:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6702:x1868797332958464:12345-0@lo:5: Request processed in 1566us (1778us total) trans 4294967297 rc 0/0 00010000:00080000:0.0:1782224112.489785:0:6702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eabd0fa300 x1868797332958464/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782224128 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224112.489793:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782224112.489810:0:6702:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0fa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6702:1868797332958464:0@lo:5: 00000004:00080000:0.0:1782224112.489824:0:6702:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1782224112.489865:0:6702:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0fa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6702:1868797332958592:0@lo:700: 00000100:00100000:0.0:1782224112.489908:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224112.489948:0:6702:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea831d3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782224112.493213:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332958592 00000100:00100000:3.0:1782224112.493226:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332958592 00000100:00100000:3.0:1782224112.494971:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782224112.494993:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6702:x1868797332958592:12345-0@lo:700: 00000100:00100000:3.0:1782224112.495079:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6591:1868797332958720:0@lo:700: 00000100:00100000:3.0:1782224112.495144:0:6591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224112.495179:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905dba80 going to sleep for 11 seconds 00000100:00100000:1.0:1782224112.495263:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332958720 00000100:00100000:1.0:1782224112.495270:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332958720 00000100:00100000:1.0:1782224112.495321:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782224112.495330:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6591:x1868797332958720:12345-0@lo:700: 00000004:00080000:3.0:1782224112.548403:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1782224112.614634:0:5793:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1782224112.623933:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6591:x1868797332958720:12345-0@lo:700: Request processed in 128596us (128779us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224112.623952:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782224112.626327:0:6591:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eaa7a08380 x1868797332958720/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782224128 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224112.626350:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6591:1868797332958720:0@lo:700: 40000000:02000000:3.0:1782224112.626367:0:6591:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1782224112.790180:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6702:x1868797332958592:12345-0@lo:700: Request processed in 295177us (300253us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224112.790230:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782224112.790271:0:6702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eabd0fa680 x1868797332958592/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782224128 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224112.790289:0:6702:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0fa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6702:1868797332958592:0@lo:700: 00000001:00080000:2.0:1782224112.790843:0:6608:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1782224112.790865:0:6608:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:1.0:1782224112.846903:0:6702:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1782224112.854415:0:6702:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6702:1868797332958848:0@lo:5: 00000100:00100000:1.0:1782224112.854509:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224112.854640:0:6702:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabba9e000 going to sleep for 11 seconds 00000100:00100000:0.0:1782224112.857580:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332958848 00000100:00100000:0.0:1782224112.857595:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332958848 00000100:00100000:0.0:1782224112.857670:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782224112.857682:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6702:x1868797332958848:12345-0@lo:5: 00002000:00080000:1.0:1782224112.873383:0:6585:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1782224112.873408:0:6585:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1782224112.881496:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6702:x1868797332958848:12345-0@lo:5: Request processed in 23805us (26975us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1782224112.881511:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782224112.884395:0:6702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96ea83f52a00 x1868797332958848/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782224128 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224112.884413:0:6702:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1782224112.884429:0:6702:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff96ea83f52a00 x1868797332958848/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782224128 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224112.884440:0:6702:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6702:1868797332958848:0@lo:5: 00000004:00080000:3.0:1782224112.884459:0:6702:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1782224113.366200:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224114.389899:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224115.412371:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224116.436286:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224117.462176:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224117.844743:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797332958976:0@lo:400: 00000100:00100000:0.0:1782224117.844848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224117.844923:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782224117.844929:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332959360:0@lo:400: 00000100:00100000:0.0:1782224117.844975:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224117.845010:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1868797332959232:0@lo:400: 00000100:00100000:0.0:1782224117.845059:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224117.846217:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782224117.846231:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797332959104:0@lo:400: 00000100:00100000:0.0:1782224117.846276:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224117.846316:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332958976 00000100:00100000:0.0:1782224117.846325:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332958976 00000100:00100000:0.0:1782224117.846381:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782224117.846390:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea90c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+16:3304:x1868797332958976:12345-0@lo:400: 00000100:00100000:0.0:1782224117.846477:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea90c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+16:3304:x1868797332958976:12345-0@lo:400: Request processed in 86us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224117.846486:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782224117.846576:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797332958976:0@lo:400: 00000100:00100000:1.0:1782224117.846712:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332959360 00000100:00100000:1.0:1782224117.846716:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332959360 00000100:00100000:1.0:1782224117.846768:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782224117.846775:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1868797332959360:12345-0@lo:400: 00000100:00100000:1.0:1782224117.846829:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1868797332959360:12345-0@lo:400: Request processed in 55us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224117.846835:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782224117.846854:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332959232 00000100:00100000:1.0:1782224117.846856:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332959232 00000100:00100000:1.0:1782224117.846880:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332959104 00000100:00100000:1.0:1782224117.846882:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332959104 00000100:00100000:1.0:1782224117.846896:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782224117.846902:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868797332959232:12345-0@lo:400: 00000100:00100000:1.0:1782224117.846934:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868797332959232:12345-0@lo:400: Request processed in 33us (1875us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224117.846940:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782224117.846949:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782224117.846954:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797332959104:12345-0@lo:400: 00000100:00100000:1.0:1782224117.846973:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797332959104:12345-0@lo:400: Request processed in 20us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224117.846978:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1782224117.847073:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eabd0fb100 x1868797332959104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224117.847086:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797332959104:0@lo:400: 00010000:00080000:1.0:1782224117.847096:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eabd0fbb80 x1868797332959232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224117.847129:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1868797332959232:0@lo:400: 00000100:00080000:0.0:1782224117.847520:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782224117.847527:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782224117.847570:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eabd0f8000 x1868797332959360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224117.847582:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332959360:0@lo:400: 00000100:00100000:0.0:1782224117.847644:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782224117.847653:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332959488:0@lo:13: 00000100:00100000:0.0:1782224117.847692:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224117.847735:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332959488 00000100:00100000:0.0:1782224117.847739:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332959488 00000100:00100000:0.0:1782224117.847772:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782224117.847778:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1868797332959488:12345-0@lo:13: 00002000:00000024:0.0:1782224117.847811:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782224117.847847:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1868797332959488:12345-0@lo:13: Request processed in 69us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224117.847853:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782224117.847880:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eabd0f8000 x1868797332959488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224133 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224117.847894:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332959488:0@lo:13: 00000001:00080000:2.0:1782224118.003605:0:6608:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1782224118.488382:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782224118.635442:0:6954:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782224119.508859:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224120.532230:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224121.559665:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224122.583784:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224122.966781:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332959616:0@lo:13: 00000100:00100000:3.0:1782224122.967203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224122.967301:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332959616 00000100:00100000:3.0:1782224122.967311:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332959616 00000100:00100000:3.0:1782224122.967382:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782224122.967393:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332959616:12345-0@lo:13: 00002000:00000024:3.0:1782224122.967449:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224122.967501:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332959616:12345-0@lo:13: Request processed in 111us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224122.967524:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1782224122.967550:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782224122.967611:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eaa7a08380 x1868797332959616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224122.967624:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1782224122.967651:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332959616:0@lo:13: 00000100:00100000:0.0:1782224122.968773:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332959872:0@lo:400: 00000100:00100000:0.0:1782224122.968858:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224122.970101:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782224122.970119:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332960000:0@lo:400: 00000100:00100000:0.0:1782224122.970177:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224122.970231:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332959872 00000100:00100000:0.0:1782224122.970241:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332959872 00000100:00100000:0.0:1782224122.970294:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332960000 00000100:00100000:0.0:1782224122.970297:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332960000 00000100:00100000:0.0:1782224122.970334:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782224122.970342:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332959872:12345-0@lo:400: 00000100:00080000:3.0:1782224122.970716:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782224122.971259:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332959872:12345-0@lo:400: Request processed in 913us (2398us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224122.971270:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782224122.971296:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782224122.971306:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332960000:12345-0@lo:400: 00000100:00100000:0.0:1782224122.971351:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332960000:12345-0@lo:400: Request processed in 48us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224122.971357:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1782224122.972125:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eabd0f9f80 x1868797332960000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224122.972144:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332960000:0@lo:400: 00010000:00080000:0.0:1782224122.972160:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eabd0fa680 x1868797332959872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224122.972168:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332959872:0@lo:400: 00000100:00100000:0.0:1782224122.972242:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332959744:0@lo:400: 00000100:00100000:0.0:1782224122.972309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224122.972367:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332959744 00000100:00100000:0.0:1782224122.972373:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332959744 00000100:00100000:0.0:1782224122.972425:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782224122.972434:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea90c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+16:3306:x1868797332959744:12345-0@lo:400: 00000100:00100000:0.0:1782224122.972479:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea90c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+16:3306:x1868797332959744:12345-0@lo:400: Request processed in 47us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224122.972487:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782224122.972525:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332959744:0@lo:400: 00010000:00010000:1.0:1782224123.609321:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224124.629609:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224125.652442:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224126.679321:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224127.714252:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224128.088623:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332960128:0@lo:400: 00000100:00100000:0.0:1782224128.088736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224128.088803:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782224128.088809:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797332960256:0@lo:400: 00000100:00100000:0.0:1782224128.088839:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224128.088872:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332960384:0@lo:400: 00000100:00100000:0.0:1782224128.088895:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224128.088913:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782224128.088917:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332960512:0@lo:400: 00000100:00100000:0.0:1782224128.088960:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224128.089000:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332960128 00000100:00100000:0.0:1782224128.089009:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332960128 00000100:00100000:0.0:1782224128.089100:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782224128.089110:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea90c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+16:3305:x1868797332960128:12345-0@lo:400: 00000100:00100000:0.0:1782224128.089167:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea90c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+16:3305:x1868797332960128:12345-0@lo:400: Request processed in 58us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224128.089185:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782224128.089225:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332960256 00000100:00100000:0.0:1782224128.089229:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332960256 00000100:00100000:0.0:1782224128.089252:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332960384 00000100:00100000:0.0:1782224128.089255:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332960384 00000100:00100000:0.0:1782224128.089285:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782224128.089291:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797332960256:12345-0@lo:400: 00000100:00100000:0.0:1782224128.089325:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797332960256:12345-0@lo:400: Request processed in 34us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224128.089331:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782224128.089341:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782224128.089347:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332960384:12345-0@lo:400: 00000100:00100000:0.0:1782224128.089377:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332960384:12345-0@lo:400: Request processed in 30us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224128.089384:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782224128.089404:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332960512 00000100:00100000:0.0:1782224128.089407:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332960512 00000100:00100000:0.0:1782224128.089438:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782224128.089444:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332960512:12345-0@lo:400: 00000100:00100000:0.0:1782224128.089475:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332960512:12345-0@lo:400: Request processed in 31us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224128.089481:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1782224128.089502:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782224128.089508:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782224128.089547:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eabd0fb800 x1868797332960512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224128.089562:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332960512:0@lo:400: 00010000:00080000:0.0:1782224128.089583:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eabd0f9f80 x1868797332960384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224128.089592:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332960384:0@lo:400: 00010000:00080000:0.0:1782224128.089624:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eabd0fa680 x1868797332960256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224128.089633:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797332960256:0@lo:400: 00000100:00100000:0.0:1782224128.089641:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332960128:0@lo:400: 00000100:00100000:0.0:1782224128.092184:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782224128.092214:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332960640:0@lo:13: 00000100:00100000:0.0:1782224128.092298:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224128.092490:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332960640 00000100:00100000:3.0:1782224128.092500:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332960640 00000100:00100000:3.0:1782224128.092553:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782224128.092564:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332960640:12345-0@lo:13: 00002000:00000024:3.0:1782224128.092608:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224128.093169:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332960640:12345-0@lo:13: Request processed in 605us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224128.093181:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1782224128.098805:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96ea88af7800 x1868797332960640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224128.098843:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332960640:0@lo:13: 00010000:00010000:0.0:1782224128.724358:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224129.755312:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782224130.328145:0:7469:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782224130.328150:0:7469:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1782224130.328309:0:7469:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff96eabfbe5800 00000020:01000004:0.0:1782224130.328330:0:7469:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1782224130.328347:0:7469:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1782224130.328366:0:7469:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff96ea833b8000) 00000020:00000080:0.0:1782224130.328393:0:7469:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1782224130.342348:0:7469:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1782224130.342888:0:7469:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1782224130.361888:0:7469:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1782224130.366442:0:7469:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1782224130.366481:0:7469:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1782224130.366623:0:7469:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1782224130.366651:0:7469:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1782224130.367186:0:7469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1782224130.367200:0:7469:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782224130.367214:0:7469:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcfd8b3ae4b1647b3 00000020:01000004:3.0:1782224130.367224:0:7469:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1782224130.367251:0:7469:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.107@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782224130.367261:0:7469:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.107@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782224130.367268:0:7469:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1782224130.367294:0:7469:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1782224130.367299:0:7469:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.107@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1782224130.400831:0:7469:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.107@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782224130.400893:0:7469:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.107@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1782224130.400899:0:7469:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782224130.400901:0:7469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782224130.400903:0:7469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782224130.400904:0:7469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782224130.400906:0:7469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782224130.400907:0:7469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782224130.400909:0:7469:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782224130.400911:0:7469:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782224130.400912:0:7469:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782224130.400914:0:7469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782224130.400916:0:7469:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782224130.400921:0:7469:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1782224130.400923:0:7469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782224130.400924:0:7469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782224130.400925:0:7469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782224130.400926:0:7469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782224130.400928:0:7469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782224130.400933:0:7469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782224130.400934:0:7469:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782224130.400935:0:7469:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782224130.400936:0:7469:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782224130.400937:0:7469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782224130.400938:0:7469:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782224130.400974:0:7469:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1782224130.404807:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf237480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332960768:0@lo:253: 00000100:00100000:2.0:1782224130.404934:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224130.404996:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc221300 going to sleep for 11 seconds 00000100:00100000:0.0:1782224130.405176:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332960768 00000100:00100000:0.0:1782224130.405188:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332960768 00000100:00100000:0.0:1782224130.405369:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782224130.405381:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+16:7469:x1868797332960768:12345-0@lo:253: 20000000:01000000:0.0:1782224130.405426:0:5781:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1782224130.405431:0:5781:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1782224130.405437:0:5781:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1782224130.405441:0:5781:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1782224130.410363:0:5781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782224130.411474:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1782224130.411499:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1782224130.412282:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1782224130.412296:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1782224130.412329:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1782224130.412392:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1782224130.414990:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1782224130.416789:0:5781:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.107@tcp 20000000:01000000:0.0:1782224130.416795:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.107@tcp (null) (null) (null) 00000040:00080000:0.0:1782224130.416929:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1782224130.416939:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1782224130.417047:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1782224130.417056:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.107@tcp (null) (null) 00000040:00080000:0.0:1782224130.417105:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1782224130.417115:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1782224130.417146:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1782224130.417194:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1782224130.417988:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1782224130.418050:0:5781:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.107@tcp 20000000:01000000:0.0:1782224130.418052:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.107@tcp (null) (null) (null) 00000040:00080000:0.0:1782224130.418088:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1782224130.418096:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1782224130.418125:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1782224130.418131:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.107@tcp (null) (null) 00000040:00080000:0.0:1782224130.418160:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1782224130.418168:0:5781:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1782224130.418214:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1782224130.418248:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1782224130.418262:0:5781:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1782224130.418265:0:5781:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1782224130.418269:0:5781:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1782224130.418293:0:5781:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782224130.418295:0:5781:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1782224130.418336:0:5781:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782224130.418339:0:5781:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782224130.421489:0:7471:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1782224130.421622:0:7471:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1782224130.421803:0:7471:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1782224130.422254:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1782224130.422297:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1782224130.422363:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1782224130.422376:0:5781:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1782224130.422379:0:5781:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1782224130.424916:0:7472:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1782224130.425339:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1782224130.425396:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1782224130.425542:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1782224130.425749:0:5781:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1782224130.425753:0:5781:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782224130.426897:0:7473:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1782224130.426985:0:7473:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1782224130.429254:0:7473:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1782224130.430377:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1782224130.430429:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1782224130.430463:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1782224130.430477:0:5781:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782224130.430479:0:5781:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782224130.432989:0:7474:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1782224130.433485:0:7474:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1782224130.433705:0:7474:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1782224130.437114:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1782224130.437177:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1782224130.437285:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1782224130.437527:0:5781:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1782224130.437530:0:5781:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1782224130.437541:0:5781:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782224130.437634:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.437658:0:5781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea80030c00/0xcfd8b3ae4b16470b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164704 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.437665:0:5781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96eabb611600/0xcfd8b3ae4b164735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16472e expref: 16 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.437672:0:5781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b16475f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164758 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.437679:0:5781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea80031a00/0xcfd8b3ae4b16477b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164774 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.437685:0:5781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96eabb710c00/0xcfd8b3ae4b1647a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16479e expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.437705:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647ba lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.437756:0:5781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96eabb710c00/0xcfd8b3ae4b1647a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b16479e expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.437773:0:5781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96eabb710c00/0xcfd8b3ae4b1647a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16479e expref: 16 pid: 5779 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224130.437790:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5781:1868797332960896:0@lo:104: 00000100:00100000:1.0:1782224130.437878:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782224130.437937:0:5781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea80031a00/0xcfd8b3ae4b16477b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b164774 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.437945:0:5781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96ea80031a00/0xcfd8b3ae4b16477b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164774 expref: 16 pid: 5780 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224130.437954:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f50700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5781:1868797332961024:0@lo:104: 00010000:00010000:1.0:1782224130.437990:0:5781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b16475f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b164758 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.437999:0:5781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b16475f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164758 expref: 16 pid: 5780 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224130.438116:0:5769:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782224130.438137:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224130.438174:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332960896 00000100:00100000:0.0:1782224130.438181:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332960896 00000100:00100000:0.0:1782224130.438227:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332961024 00000100:00100000:0.0:1782224130.438229:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332961024 00000100:00100000:0.0:1782224130.438245:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782224130.438255:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88644450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b33607d9-62cb-4729-8187-59883763158a+4:5781:x1868797332960896:12345-0@lo:104: 00010000:00010000:0.0:1782224130.438272:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96ea80031200/0xcfd8b3ae4b16479e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1647a5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.438347:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782224130.438353:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88644450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b33607d9-62cb-4729-8187-59883763158a+4:5781:x1868797332960896:12345-0@lo:104: Request processed in 100us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224130.438362:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782224130.438404:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782224130.438410:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b33607d9-62cb-4729-8187-59883763158a+3:5781:x1868797332961024:12345-0@lo:104: 00010000:00010000:0.0:1782224130.438417:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96ea80030400/0xcfd8b3ae4b164774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b16477b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.438449:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782224130.438454:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b33607d9-62cb-4729-8187-59883763158a+3:5781:x1868797332961024:12345-0@lo:104: Request processed in 45us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224130.438460:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1782224130.438478:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782224130.438485:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea80031200/0xcfd8b3ae4b16479e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1647a5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.438493:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea80031200 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:0.0:1782224130.438499:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea80031200/0xcfd8b3ae4b16479e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b1647a5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.438509:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea80031200/0xcfd8b3ae4b16479e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b1647a5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782224130.438518:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea80031200/0xcfd8b3ae4b16479e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b1647a5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782224130.438525:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782224130.438675:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96ea80031200/0xcfd8b3ae4b16479e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1647a5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.438682:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782224130.438715:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea80031200/0xcfd8b3ae4b16479e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1647a5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.438722:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea80031200/0xcfd8b3ae4b16479e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1647a5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.438740:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224130.438743:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea80030400/0xcfd8b3ae4b164774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b16477b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.438749:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea80030400 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:0.0:1782224130.438753:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea80030400/0xcfd8b3ae4b164774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b16477b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.438760:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea80030400/0xcfd8b3ae4b164774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b16477b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782224130.438766:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea80030400/0xcfd8b3ae4b164774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b16477b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782224130.438771:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782224130.438784:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96ea80030400/0xcfd8b3ae4b164774 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16477b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.438790:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782224130.438806:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea80030400/0xcfd8b3ae4b164774 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16477b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.438823:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea80030400/0xcfd8b3ae4b164774 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16477b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.438836:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224130.438837:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224130.438839:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224130.438846:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224130.438863:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782224130.438878:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332961280:0@lo:103: 00000100:00100000:0.0:1782224130.438912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224130.438942:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797332961408:0@lo:103: 00000100:00100000:0.0:1782224130.438965:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224130.439039:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332961280 00000100:00100000:0.0:1782224130.439045:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332961280 00010000:00010000:0.0:1782224130.439065:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96eabb710c00/0xcfd8b3ae4b1647a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16479e expref: 17 pid: 5779 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224130.439086:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332961408 00000100:00100000:0.0:1782224130.439089:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332961408 00010000:00010000:0.0:1782224130.439098:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea80031a00/0xcfd8b3ae4b16477b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164774 expref: 18 pid: 5780 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224130.439111:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782224130.439117:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b33607d9-62cb-4729-8187-59883763158a+18:3305:x1868797332961280:12345-0@lo:103: 00010000:00010000:0.0:1782224130.439129:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224130.439135:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96eabb710c00/0xcfd8b3ae4b1647a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16479e expref: 18 pid: 5779 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224130.439247:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f53480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5781:1868797332961152:0@lo:104: 00000100:00100000:1.0:1782224130.439274:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782224130.439349:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96eabb710c00/0xcfd8b3ae4b1647a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16479e expref: 18 pid: 5779 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.439369:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224130.439399:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b33607d9-62cb-4729-8187-59883763158a+18:3305:x1868797332961280:12345-0@lo:103: Request processed in 282us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224130.439406:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782224130.439420:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782224130.439426:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b33607d9-62cb-4729-8187-59883763158a+17:3303:x1868797332961408:12345-0@lo:103: 00010000:00010000:0.0:1782224130.439434:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224130.439438:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea80031a00/0xcfd8b3ae4b16477b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164774 expref: 17 pid: 5780 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.439446:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea80031a00/0xcfd8b3ae4b16477b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164774 expref: 17 pid: 5780 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.439454:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224130.439478:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b33607d9-62cb-4729-8187-59883763158a+17:3303:x1868797332961408:12345-0@lo:103: Request processed in 52us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224130.439484:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782224130.439528:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797332961408:0@lo:103: 00000100:00100000:0.0:1782224130.439564:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332961280:0@lo:103: 00010000:00010000:1.0:1782224130.439825:0:5781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96eabb611600/0xcfd8b3ae4b164735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b16472e expref: 16 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.439848:0:5781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96eabb611600/0xcfd8b3ae4b164735 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16472e expref: 16 pid: 5781 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224130.439857:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f53100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5781:1868797332961536:0@lo:104: 00000100:00100000:1.0:1782224130.439883:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782224130.439991:0:5781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea80030c00/0xcfd8b3ae4b16470b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b164704 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.440009:0:5781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96ea80030c00/0xcfd8b3ae4b16470b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164704 expref: 16 pid: 5779 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224130.440046:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5781:1868797332961664:0@lo:104: 00000100:00100000:1.0:1782224130.440069:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224130.440161:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332961152 00000100:00100000:3.0:1782224130.440167:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332961152 00000100:00100000:0.0:1782224130.440336:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332961536 00000100:00100000:0.0:1782224130.440341:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332961536 00000100:00100000:0.0:1782224130.440361:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782224130.440369:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+4:5781:x1868797332961152:12345-0@lo:104: 00010000:00010000:0.0:1782224130.440390:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96ea99876200/0xcfd8b3ae4b164758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b16475f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.440432:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782224130.440438:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+4:5781:x1868797332961152:12345-0@lo:104: Request processed in 70us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224130.440444:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782224130.440460:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782224130.440467:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+3:5781:x1868797332961536:12345-0@lo:104: 00010000:00010000:0.0:1782224130.440475:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b16472e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164735 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.440507:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782224130.440511:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+3:5781:x1868797332961536:12345-0@lo:104: Request processed in 46us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224130.440650:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1782224130.440670:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782224130.440675:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea99876200/0xcfd8b3ae4b164758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b16475f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.440683:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876200 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:0.0:1782224130.440687:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea99876200/0xcfd8b3ae4b164758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b16475f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.440696:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea99876200/0xcfd8b3ae4b164758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b16475f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782224130.440702:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea99876200/0xcfd8b3ae4b164758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b16475f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782224130.440718:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782224130.440747:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96ea99876200/0xcfd8b3ae4b164758 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16475f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.440753:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782224130.440771:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea99876200/0xcfd8b3ae4b164758 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16475f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.440778:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea99876200/0xcfd8b3ae4b164758 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16475f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.440789:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224130.440793:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b16472e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164735 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.440798:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabb711600 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:0.0:1782224130.440801:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b16472e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b164735 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.440807:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b16472e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b164735 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782224130.440813:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b16472e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b164735 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782224130.440817:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782224130.440829:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b16472e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164735 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.440834:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782224130.440855:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b16472e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164735 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.440862:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabb711600/0xcfd8b3ae4b16472e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164735 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.440873:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224130.440875:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224130.440877:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224130.440883:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782224130.440894:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332961920:0@lo:103: 00000100:00100000:0.0:1782224130.440928:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224130.440964:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797332961792:0@lo:103: 00000100:00100000:0.0:1782224130.440987:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224130.441049:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332961920 00000100:00100000:0.0:1782224130.441054:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332961920 00010000:00010000:0.0:1782224130.441073:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96eabb611600/0xcfd8b3ae4b164735 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16472e expref: 17 pid: 5781 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224130.441093:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332961792 00000100:00100000:0.0:1782224130.441096:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332961792 00010000:00010000:0.0:1782224130.441107:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b16475f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164758 expref: 18 pid: 5780 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224130.441119:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782224130.441126:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+18:3306:x1868797332961920:12345-0@lo:103: 00010000:00010000:0.0:1782224130.441135:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224130.441140:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96eabb611600/0xcfd8b3ae4b164735 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16472e expref: 18 pid: 5781 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.441160:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96eabb611600/0xcfd8b3ae4b164735 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16472e expref: 18 pid: 5781 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.441174:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224130.441202:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+18:3306:x1868797332961920:12345-0@lo:103: Request processed in 77us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224130.441209:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782224130.441222:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782224130.441227:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+17:3304:x1868797332961792:12345-0@lo:103: 00010000:00010000:0.0:1782224130.441235:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224130.441239:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b16475f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164758 expref: 17 pid: 5780 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.441248:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b16475f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164758 expref: 17 pid: 5780 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.441257:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224130.441278:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+17:3304:x1868797332961792:12345-0@lo:103: Request processed in 51us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224130.441284:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782224130.441320:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797332961792:0@lo:103: 00000100:00100000:0.0:1782224130.441341:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332961920:0@lo:103: 00010000:00010000:0.0:1782224130.441357:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224130.441502:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea851d1780 going to sleep for 11 seconds 00010000:00010000:1.0:1782224130.441750:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabb710c00/0xcfd8b3ae4b1647a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b16479e expref: 16 pid: 5779 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224130.441765:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5781:1868797332960896:0@lo:104: 00010000:00010000:1.0:1782224130.441780:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea80031a00/0xcfd8b3ae4b16477b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b164774 expref: 15 pid: 5780 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224130.441788:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f50700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5781:1868797332961024:0@lo:104: 00010000:00010000:1.0:1782224130.441798:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b16475f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b164758 expref: 14 pid: 5780 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224130.441806:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f53480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5781:1868797332961152:0@lo:104: 00010000:00010000:1.0:1782224130.441813:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabb611600/0xcfd8b3ae4b164735 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b16472e expref: 13 pid: 5781 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224130.441831:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f53100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5781:1868797332961536:0@lo:104: 00000100:00100000:3.0:1782224130.441904:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332961664 00000100:00100000:3.0:1782224130.441909:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332961664 00000100:00100000:3.0:1782224130.441933:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782224130.441941:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b33607d9-62cb-4729-8187-59883763158a+3:5781:x1868797332961664:12345-0@lo:104: 00010000:00010000:3.0:1782224130.441952:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eabb711a00/0xcfd8b3ae4b164704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b16470b expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224130.442041:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782224130.442046:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b33607d9-62cb-4729-8187-59883763158a+3:5781:x1868797332961664:12345-0@lo:104: Request processed in 107us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224130.442052:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1782224130.442153:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782224130.442160:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabb711a00/0xcfd8b3ae4b164704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b16470b expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.442168:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabb711a00 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:2.0:1782224130.442173:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabb711a00/0xcfd8b3ae4b164704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b16470b expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.442181:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabb711a00/0xcfd8b3ae4b164704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b16470b expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782224130.442188:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabb711a00/0xcfd8b3ae4b164704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b16470b expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224130.442194:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782224130.442221:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabb711a00/0xcfd8b3ae4b164704 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16470b expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.442228:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782224130.442240:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabb711a00/0xcfd8b3ae4b164704 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16470b expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.442260:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabb711a00/0xcfd8b3ae4b164704 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16470b expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.442276:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224130.442278:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224130.442279:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224130.442356:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332962048:0@lo:103: 00000100:00100000:0.0:1782224130.442391:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224130.442498:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5781:1868797332961664:0@lo:104: 00010000:00010000:1.0:1782224130.442536:0:5781:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224130.442643:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332962048 00000100:00100000:2.0:1782224130.442648:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332962048 00010000:00010000:2.0:1782224130.442669:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea80030c00/0xcfd8b3ae4b16470b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164704 expref: 13 pid: 5779 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224130.442697:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782224130.442705:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+13:3306:x1868797332962048:12345-0@lo:103: 00010000:00010000:2.0:1782224130.442715:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224130.442720:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea80030c00/0xcfd8b3ae4b16470b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164704 expref: 13 pid: 5779 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.442731:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea80030c00/0xcfd8b3ae4b16470b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164704 expref: 13 pid: 5779 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.442744:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea80030c00/0xcfd8b3ae4b16470b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b164704 expref: 13 pid: 5779 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.442760:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647ba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.442770:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647ba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.442797:0:5772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.442805:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.442813:0:5772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647ba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.442821:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.442827:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99877600 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:2.0:1782224130.442832:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.442841:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647ba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.442860:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647ba lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.442871:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224130.442906:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+12:3306:x1868797332962048:12345-0@lo:103: Request processed in 202us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224130.442913:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1782224130.445310:0:5781:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.445335:0:5781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.445343:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647ba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782224130.445373:0:5781:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1782224130.445688:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332962048:0@lo:103: 00000100:00100000:2.0:1782224130.531451:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+11:7469:x1868797332960768:12345-0@lo:253: Request processed in 126058us (126506us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224130.531470:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782224130.532385:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf237480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332960768:0@lo:253: 10000000:01000000:0.0:1782224130.532407:0:7469:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1782224130.532411:0:7469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782224130.532413:0:7469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782224130.532414:0:7469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782224130.532416:0:7469:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1782224130.532417:0:7469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782224130.532419:0:7469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782224130.532420:0:7469:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782224130.532422:0:7469:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1782224130.532424:0:7469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782224130.532425:0:7469:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782224130.532455:0:7469:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96eabfbe5800 from lustre-OST0001 10000000:01000000:0.0:1782224130.532486:0:7469:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1782224130.532489:0:7469:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1782224130.532499:0:7469:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96ea833bcd40 local copy 10000000:01000000:0.0:1782224130.532504:0:7469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782224130.532808:0:7469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb86800/0xcfd8b3ae4b1647c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.532822:0:7469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.107@tcp lock: ffff96eabbb86800/0xcfd8b3ae4b1647c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.532833:0:7469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabbb86800/0xcfd8b3ae4b1647c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224130.532855:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332962176:0@lo:101: 00000100:00100000:0.0:1782224130.532921:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224130.533064:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaaa257480 going to sleep for 11 seconds 00000100:00100000:2.0:1782224130.533174:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332962176 00000100:00100000:2.0:1782224130.533198:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332962176 00000100:00100000:2.0:1782224130.533293:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782224130.533304:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+11:7469:x1868797332962176:12345-0@lo:101: 00010000:00010000:2.0:1782224130.533321:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224130.533337:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabb611800/0xcfd8b3ae4b1647c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1647c1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.533364:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabb611800/0xcfd8b3ae4b1647c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1647c1 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.533375:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabb611800/0xcfd8b3ae4b1647c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1647c1 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.533386:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabb611800, rc 0) 00000100:00100000:2.0:1782224130.533438:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+12:7469:x1868797332962176:12345-0@lo:101: Request processed in 136us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224130.533445:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782224130.533533:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332962176:0@lo:101: 00010000:00010000:0.0:1782224130.533548:0:7469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabbb86800/0xcfd8b3ae4b1647c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcfd8b3ae4b1647c8 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.533574:0:7469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabbb86800/0xcfd8b3ae4b1647c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcfd8b3ae4b1647c8 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224130.533700:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332962304:0@lo:501: 00000100:00100000:0.0:1782224130.533730:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224130.533983:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaaa257480 going to sleep for 11 seconds 00000100:00100000:1.0:1782224130.534096:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332962304 00000100:00100000:1.0:1782224130.534101:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332962304 00000100:00100000:1.0:1782224130.534129:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782224130.534137:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:7469:x1868797332962304:12345-0@lo:501: 00000100:00100000:1.0:1782224130.534403:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:7469:x1868797332962304:12345-0@lo:501: Request processed in 266us (670us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782224130.534412:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782224130.534535:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332962304:0@lo:501: 10000000:01000000:0.0:1782224130.534678:0:7469:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.107@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1782224130.534712:0:7469:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.107@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1782224130.534719:0:7469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb86800/0xcfd8b3ae4b1647c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcfd8b3ae4b1647c8 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.534730:0:7469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb86800/0xcfd8b3ae4b1647c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcfd8b3ae4b1647c8 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.534739:0:7469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff96eabbb86800/0xcfd8b3ae4b1647c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcfd8b3ae4b1647c8 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.534770:0:7469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1782224130.534800:0:7469:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96eabfbe5800 10000000:01000000:0.0:1782224130.534806:0:7469:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1782224130.534813:0:7469:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1782224130.534815:0:7469:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782224130.534820:0:7469:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1782224130.534822:0:7469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1782224130.534845:0:7469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb86200/0xcfd8b3ae4b1647cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.534865:0:7469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabbb86200/0xcfd8b3ae4b1647cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.534875:0:7469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabbb86200/0xcfd8b3ae4b1647cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224130.534892:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332962432:0@lo:101: 00000100:00100000:0.0:1782224130.534927:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224130.534954:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaaa257cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1782224130.535037:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224130.535044:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabbb86800/0xcfd8b3ae4b1647c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcfd8b3ae4b1647c8 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.535052:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86800 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:1.0:1782224130.535056:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabbb86800/0xcfd8b3ae4b1647c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcfd8b3ae4b1647c8 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.535072:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabbb86800/0xcfd8b3ae4b1647c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcfd8b3ae4b1647c8 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224130.535079:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabbb86800/0xcfd8b3ae4b1647c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcfd8b3ae4b1647c8 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224130.535085:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782224130.535104:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabbb86800/0xcfd8b3ae4b1647c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcfd8b3ae4b1647c8 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.535111:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782224130.535141:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabbb86800/0xcfd8b3ae4b1647c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcfd8b3ae4b1647c8 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.535149:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabbb86800/0xcfd8b3ae4b1647c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcfd8b3ae4b1647c8 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.535163:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224130.535165:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224130.535167:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224130.535176:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782224130.535188:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797332962560:0@lo:103: 00000100:00100000:1.0:1782224130.535219:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224130.535253:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332962560 00000100:00100000:1.0:1782224130.535258:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332962560 00000100:00100000:1.0:1782224130.535298:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782224130.535308:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b33607d9-62cb-4729-8187-59883763158a+12:3304:x1868797332962560:12345-0@lo:103: 00010000:00010000:1.0:1782224130.535321:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224130.535337:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabb611800/0xcfd8b3ae4b1647c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfd8b3ae4b1647c1 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.535363:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224130.535395:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b33607d9-62cb-4729-8187-59883763158a+11:3304:x1868797332962560:12345-0@lo:103: Request processed in 88us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224130.535402:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782224130.535430:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797332962560:0@lo:103: 00000100:00100000:1.0:1782224130.535448:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332962432 00000100:00100000:1.0:1782224130.535451:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332962432 00000100:00100000:1.0:1782224130.535468:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782224130.535473:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+11:7469:x1868797332962432:12345-0@lo:101: 00010000:00010000:1.0:1782224130.535484:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224130.535498:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1647cf expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.535529:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1647cf expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.535540:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1647cf expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.535548:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99877600, rc 0) 00000100:00100000:1.0:1782224130.535864:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:7469:x1868797332962432:12345-0@lo:101: Request processed in 389us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224130.535869:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782224130.535973:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332962432:0@lo:101: 00010000:00010000:0.0:1782224130.535986:0:7469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabbb86200/0xcfd8b3ae4b1647cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1647d6 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.535997:0:7469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabbb86200/0xcfd8b3ae4b1647cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b1647d6 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224130.536127:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332962688:0@lo:501: 00000100:00100000:0.0:1782224130.536158:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224130.536187:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaaa257cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782224130.536331:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332962688 00000100:00100000:1.0:1782224130.536336:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332962688 00000100:00100000:1.0:1782224130.536354:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782224130.536360:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:7469:x1868797332962688:12345-0@lo:501: 00000100:00100000:1.0:1782224130.536761:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+12:7469:x1868797332962688:12345-0@lo:501: Request processed in 399us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224130.536769:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782224130.536989:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332962688:0@lo:501: 00000100:00100000:2.0:1782224130.537333:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332962816:0@lo:503: 00000100:00100000:2.0:1782224130.537392:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224130.537460:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc221d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782224130.537498:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332962816 00000100:00100000:1.0:1782224130.537503:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332962816 00000100:00100000:2.0:1782224130.544697:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782224130.544725:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+12:7469:x1868797332962816:12345-0@lo:503: 00000100:00100000:2.0:1782224130.545748:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+12:7469:x1868797332962816:12345-0@lo:503: Request processed in 1030us (8351us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224130.545760:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782224130.548682:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332962816:0@lo:503: 00000040:00080000:2.0:1782224130.552467:0:7469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782224130.552722:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332962944:0@lo:502: 00000100:00100000:2.0:1782224130.552823:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224130.552944:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc221000 going to sleep for 11 seconds 00000100:00100000:3.0:1782224130.556254:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332962944 00000100:00100000:3.0:1782224130.556274:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332962944 00000100:00100000:3.0:1782224130.556428:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782224130.556440:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+12:7469:x1868797332962944:12345-0@lo:502: 00000100:00100000:3.0:1782224130.557506:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+12:7469:x1868797332962944:12345-0@lo:502: Request processed in 1061us (4676us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224130.557519:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782224130.558500:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332962944:0@lo:502: 00000040:00080000:2.0:1782224130.561886:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1782224130.562037:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1782224130.562077:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1782224130.562126:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1782224130.562165:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1782224130.562199:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1782224130.562261:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332963072:0@lo:502: 00000100:00100000:2.0:1782224130.562379:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224130.562437:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc221000 going to sleep for 11 seconds 00000100:00100000:0.0:1782224130.563619:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332963072 00000100:00100000:0.0:1782224130.563634:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332963072 00000100:00100000:0.0:1782224130.563710:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782224130.563722:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+12:7469:x1868797332963072:12345-0@lo:502: 00000100:00100000:0.0:1782224130.564074:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+12:7469:x1868797332963072:12345-0@lo:502: Request processed in 353us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224130.564089:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782224130.564387:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332963072:0@lo:502: 00000040:00080000:2.0:1782224130.564697:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1782224130.564714:0:7469:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1782224130.565815:0:7477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782224130.565827:0:7477:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1782224130.565835:0:7477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224130.565838:0:7477:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1782224130.565845:0:7477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782224130.565862:0:7477:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff96ea833bb380) 00000020:00000080:0.0:1782224130.565902:0:7477:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1782224130.565910:0:7477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782224130.565974:0:7477:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96eabfbe5800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1782224130.565982:0:7477:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1782224130.565989:0:7477:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcfd8b3ae4b1647e4 00010000:00010000:1.0:1782224130.578388:0:7477:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1782224130.580324:0:7477:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1782224130.586113:0:7477:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1782224130.586479:0:7477:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1782224130.595977:0:7477:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1782224130.602419:0:7477:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1782224130.608629:0:7477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1782224130.608646:0:7477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782224130.608654:0:7477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224130.608656:0:7477:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1782224130.608660:0:7477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782224130.608664:0:7477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224130.608665:0:7477:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782224130.608669:0:7477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782224130.608671:0:7477:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782224130.608748:0:7477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782224130.608752:0:7477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224130.608754:0:7477:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782224130.608757:0:7477:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1782224130.609118:0:7469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1782224130.609157:0:7469:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782224130.609187:0:7469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb86200/0xcfd8b3ae4b1647cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1647d6 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.609204:0:7469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabbb86200/0xcfd8b3ae4b1647cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1647d6 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224130.609213:0:7469:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96eabfbe5800 from 1 10000000:01000000:2.0:1782224130.609217:0:7469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782224130.609259:0:7469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb610200/0xcfd8b3ae4b1647eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.609268:0:7469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabb610200/0xcfd8b3ae4b1647eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.609295:0:7469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabb610200/0xcfd8b3ae4b1647eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224130.609325:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332963200:0@lo:101: 00000100:00100000:2.0:1782224130.609422:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224130.609471:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc221240 going to sleep for 11 seconds 00000100:00100000:1.0:1782224130.609689:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332963200 00000100:00100000:1.0:1782224130.609698:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332963200 00000100:00100000:1.0:1782224130.609758:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782224130.609769:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+12:7469:x1868797332963200:12345-0@lo:101: 00010000:00010000:1.0:1782224130.609787:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224130.609802:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b1647f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1647eb expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.609846:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b1647f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1647eb expref: 13 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.609857:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b1647f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1647eb expref: 13 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224130.609866:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99877a00, rc 0) 00000100:00100000:1.0:1782224130.609925:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+13:7469:x1868797332963200:12345-0@lo:101: Request processed in 157us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224130.609933:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782224130.610054:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332963200:0@lo:101: 00010000:00010000:3.0:1782224130.610072:0:7469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabb610200/0xcfd8b3ae4b1647eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1647f2 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224130.610081:0:7469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabb610200/0xcfd8b3ae4b1647eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b1647f2 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224130.610209:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332963328:0@lo:501: 00000100:00100000:3.0:1782224130.610239:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224130.610264:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa7a0fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1782224130.611706:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332963328 00000100:00100000:1.0:1782224130.611719:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332963328 00000100:00100000:1.0:1782224130.611769:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782224130.611779:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:7469:x1868797332963328:12345-0@lo:501: 00000100:00100000:1.0:1782224130.612139:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:7469:x1868797332963328:12345-0@lo:501: Request processed in 361us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224130.612147:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782224130.612447:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332963328:0@lo:501: 00000100:00100000:3.0:1782224130.612501:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332963456:0@lo:503: 00000100:00100000:3.0:1782224130.612638:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224130.612678:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa7a0fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1782224130.612725:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332963456 00000100:00100000:2.0:1782224130.612731:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332963456 00000100:00100000:2.0:1782224130.612777:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782224130.612786:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:7469:x1868797332963456:12345-0@lo:503: 00000100:00100000:2.0:1782224130.613180:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:7469:x1868797332963456:12345-0@lo:503: Request processed in 395us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224130.613189:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782224130.613292:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332963456:0@lo:503: 00000040:00080000:3.0:1782224130.613690:0:7469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782224130.613771:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332963584:0@lo:502: 00000100:00100000:3.0:1782224130.613817:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224130.613845:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa7a0fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1782224130.614710:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332963584 00000100:00100000:2.0:1782224130.614725:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332963584 00000100:00100000:2.0:1782224130.614792:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782224130.614805:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+13:7469:x1868797332963584:12345-0@lo:502: 00000100:00100000:2.0:1782224130.615126:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+13:7469:x1868797332963584:12345-0@lo:502: Request processed in 323us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224130.615135:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782224130.615381:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332963584:0@lo:502: 00000040:00080000:3.0:1782224130.615827:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1782224130.615889:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1782224130.615928:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332963712:0@lo:502: 00000100:00100000:3.0:1782224130.615980:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224130.616958:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa7a0fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1782224130.623874:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332963712 00000100:00100000:1.0:1782224130.623893:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332963712 00000100:00100000:1.0:1782224130.625186:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782224130.625201:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83492450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+13:7469:x1868797332963712:12345-0@lo:502: 00000100:00100000:1.0:1782224130.625674:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83492450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+13:7469:x1868797332963712:12345-0@lo:502: Request processed in 474us (9692us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224130.625684:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782224130.633764:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332963712:0@lo:502: 00000040:00080000:3.0:1782224130.634074:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1782224130.634094:0:7469:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1782224130.639891:0:7481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782224130.639908:0:7481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224130.639911:0:7481:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782224130.639920:0:7481:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96eabfbe5800 00000020:00000080:3.0:1782224130.639922:0:7481:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782224130.639940:0:7481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782224130.639943:0:7481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224130.639945:0:7481:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1782224130.639948:0:7481:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1782224130.640784:0:7469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1782224130.640819:0:7469:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782224130.640846:0:7469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb610200/0xcfd8b3ae4b1647eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1647f2 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.640860:0:7469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabb610200/0xcfd8b3ae4b1647eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1647f2 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224130.640934:0:7469:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782224130.640938:0:7469:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96eabfbe5800 10000000:01000000:2.0:1782224130.640941:0:7469:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96eabfbe5800 10000000:01000000:2.0:1782224130.640946:0:7469:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782224130.640953:0:7469:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff96eabfbe5800 from 1 10000000:01000000:2.0:1782224130.640957:0:7469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782224130.641012:0:7469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b1647f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.641080:0:7469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b1647f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.641094:0:7469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b1647f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224130.641122:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf237480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332963840:0@lo:101: 00000100:00100000:2.0:1782224130.641212:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224130.641299:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc221d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782224130.643223:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332963840 00000100:00100000:0.0:1782224130.643240:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332963840 00000100:00100000:2.0:1782224130.649895:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782224130.649913:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:7469:x1868797332963840:12345-0@lo:101: 00010000:00010000:2.0:1782224130.649938:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224130.649962:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabb611800/0xcfd8b3ae4b164800 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1647f9 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.650721:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabb611800/0xcfd8b3ae4b164800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1647f9 expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.650746:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabb611800/0xcfd8b3ae4b164800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1647f9 expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224130.650779:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabb611800, rc 0) 00000100:00100000:2.0:1782224130.650956:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+14:7469:x1868797332963840:12345-0@lo:101: Request processed in 1046us (9742us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224130.650964:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782224130.652945:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf237480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332963840:0@lo:101: 00010000:00010000:3.0:1782224130.652982:0:7469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b1647f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164800 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224130.652996:0:7469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b1647f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164800 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224130.653890:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332963968:0@lo:501: 00000100:00100000:3.0:1782224130.653975:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224130.654126:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa7a0fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1782224130.657288:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332963968 00000100:00100000:2.0:1782224130.657309:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332963968 00000100:00100000:2.0:1782224130.657389:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782224130.657401:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+14:7469:x1868797332963968:12345-0@lo:501: 00000100:00100000:2.0:1782224130.660157:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+14:7469:x1868797332963968:12345-0@lo:501: Request processed in 2746us (6169us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224130.660174:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782224130.660354:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332963968:0@lo:501: 00000100:00100000:0.0:1782224130.660422:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332964096:0@lo:503: 00000100:00100000:0.0:1782224130.660481:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224130.660541:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaaa257780 going to sleep for 11 seconds 00000100:00100000:2.0:1782224130.660826:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332964096 00000100:00100000:2.0:1782224130.660834:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332964096 00000100:00100000:2.0:1782224130.660887:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782224130.660896:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+14:7469:x1868797332964096:12345-0@lo:503: 00000100:00100000:2.0:1782224130.661145:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+14:7469:x1868797332964096:12345-0@lo:503: Request processed in 249us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224130.661152:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782224130.661335:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332964096:0@lo:503: 00000040:00080000:1.0:1782224130.661970:0:7469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782224130.662091:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332964224:0@lo:502: 00000100:00100000:1.0:1782224130.662157:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224130.662199:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8352c180 going to sleep for 11 seconds 00000100:00100000:0.0:1782224130.662263:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332964224 00000100:00100000:0.0:1782224130.662270:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332964224 00000100:00100000:0.0:1782224130.662316:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782224130.662326:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+14:7469:x1868797332964224:12345-0@lo:502: 00000100:00100000:0.0:1782224130.662730:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+14:7469:x1868797332964224:12345-0@lo:502: Request processed in 403us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224130.662738:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782224130.662829:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332964224:0@lo:502: 00000040:00080000:1.0:1782224130.663135:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1782224130.663193:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1782224130.663229:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1782224130.663277:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1782224130.663313:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1782224130.663360:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1782224130.663395:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1782224130.663427:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1782224130.663486:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1782224130.663655:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1782224130.663697:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1782224130.663748:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1782224130.663784:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1782224130.663816:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1782224130.663860:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1782224130.663894:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1782224130.663925:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1782224130.663983:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1782224130.664061:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1782224130.664096:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1782224130.664144:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1782224130.664182:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1782224130.664215:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1782224130.664278:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1782224130.664326:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1782224130.664363:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1782224130.664412:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1782224130.664447:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1782224130.664490:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1782224130.665789:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1782224130.665871:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1782224130.665907:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1782224130.665943:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1782224130.665993:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1782224130.666059:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1782224130.666106:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1782224130.666143:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1782224130.666206:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332964352:0@lo:502: 00000100:00100000:1.0:1782224130.666315:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224130.666458:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8352c180 going to sleep for 11 seconds 00000100:00100000:2.0:1782224130.669772:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332964352 00000100:00100000:2.0:1782224130.669792:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332964352 00000100:00100000:2.0:1782224130.670115:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782224130.670130:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+14:7469:x1868797332964352:12345-0@lo:502: 00000100:00100000:2.0:1782224130.670530:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+14:7469:x1868797332964352:12345-0@lo:502: Request processed in 402us (4213us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224130.670539:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782224130.670739:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332964352:0@lo:502: 00000040:00080000:3.0:1782224130.670878:0:7469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1782224130.670898:0:7469:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1782224130.674780:0:7482:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1782224130.674805:0:7482:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff96ea83eccd40) 00000020:00000080:3.0:1782224130.674835:0:7482:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1782224130.675088:0:7482:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96eabfbe5800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782224130.675100:0:7482:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96eabfbe5800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782224130.675103:0:7482:0:(obd_mount.c:701:lustre_put_lsi()) put ffff96eabfbe5800 3 00010000:00080000:3.0:1782224130.675139:0:7482:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96eabfc75000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.107@tcp at head 00010000:00010000:3.0:1782224130.676823:0:7482:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1782224130.676944:0:7482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1782224130.676983:0:7482:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782224130.676997:0:7482:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcfd8b3ae4b16480e 00000100:00080000:3.0:1782224130.677056:0:7482:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782224130.677065:0:7482:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96eabfc75000 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:3.0:1782224130.677112:0:7482:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96eaa7a0a300 x1868797332964480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782224130.677170:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1868797332964480:0@lo:38: 00000100:00100000:3.0:1782224130.677260:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224130.677337:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332964480 00000100:00100000:3.0:1782224130.677345:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332964480 00000100:00100000:3.0:1782224130.677386:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782224130.677394:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1868797332964480:12345-0@lo:38: 00010000:00080000:3.0:1782224130.677424:0:5787:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:3.0:1782224130.677472:0:5787:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcfd8b3ae4b164815 00000004:00100000:3.0:1782224130.677491:0:5787:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782224130.677526:0:5787:0:(import.c:65:import_set_state_nolock()) ffff96eabfc75800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782224130.677582:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1868797332964480:12345-0@lo:38: Request processed in 186us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224130.677590:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782224130.677633:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eaa7a0a300 x1868797332964480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782224140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224130.677645:0:3302:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782224130.677662:0:3302:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1782224130.677671:0:3302:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1782224130.677675:0:3302:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782224130.677679:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96eabfc75000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782224130.677687:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1868797332964480:0@lo:38: 00000100:00080000:3.0:1782224130.677710:0:7482:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782224130.677810:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782224130.677819:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332964608:0@lo:400: 00000100:00100000:3.0:1782224130.677846:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224130.677871:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797332964736:0@lo:400: 00000100:00100000:3.0:1782224130.677892:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224130.677909:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782224130.677913:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332964864:0@lo:400: 00000100:00100000:3.0:1782224130.677939:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224130.677969:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332964608 00000100:00100000:3.0:1782224130.677973:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332964608 00000100:00100000:1.0:1782224130.681288:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332964864 00000100:00100000:1.0:1782224130.681304:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332964864 00000100:00100000:1.0:1782224130.681389:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782224130.681400:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332964864:12345-0@lo:400: 00000100:00100000:1.0:1782224130.681529:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332964864:12345-0@lo:400: Request processed in 131us (3587us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224130.681537:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1782224130.681649:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782224130.681691:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eaa7a0ad80 x1868797332964864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224130.681708:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332964864:0@lo:400: 00000100:00100000:3.0:1782224130.686733:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332964736 00000100:00100000:3.0:1782224130.686753:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332964736 00000100:00100000:3.0:1782224130.686826:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782224130.686838:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332964608:12345-0@lo:400: 00000100:00100000:3.0:1782224130.686951:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332964608:12345-0@lo:400: Request processed in 115us (9103us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224130.686959:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782224130.686976:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782224130.686982:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797332964736:12345-0@lo:400: 00000100:00100000:3.0:1782224130.687047:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797332964736:12345-0@lo:400: Request processed in 64us (9152us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224130.687064:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1782224130.687122:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eaa7a0a300 x1868797332964608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224130.687140:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332964608:0@lo:400: 00000100:00080000:1.0:1782224130.687361:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782224130.687388:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eaa7a09880 x1868797332964736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224130.687399:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797332964736:0@lo:400: 00000100:00100000:1.0:1782224130.687748:0:7484:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f53480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7484:1868797332964992:0@lo:901: 00000100:00100000:1.0:1782224130.687818:0:7484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224130.687855:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332964992 00000100:00100000:1.0:1782224130.687860:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332964992 00000100:00100000:1.0:1782224130.687902:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782224130.687909:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7484:x1868797332964992:12345-0@lo:901: 00000100:00100000:1.0:1782224130.688411:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7484:x1868797332964992:12345-0@lo:901: Request processed in 499us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224130.688420:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1782224130.688446:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224130.688462:0:7484:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8352ce40 going to sleep for 11 seconds 00010000:00080000:1.0:1782224130.688483:0:7484:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96ea83f53480 x1868797332964992/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1782224146 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224130.688496:0:7484:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f53480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7484:1868797332964992:0@lo:901: 00000040:00080000:3.0:1782224130.688812:0:7482:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1782224130.689068:0:7469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1782224130.689102:0:7469:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782224130.689134:0:7469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b1647f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164800 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.689145:0:7469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b1647f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164800 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782224130.689212:0:7469:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782224130.689214:0:7469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782224130.689216:0:7469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782224130.689217:0:7469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782224130.689218:0:7469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782224130.689220:0:7469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782224130.689221:0:7469:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782224130.689223:0:7469:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782224130.689225:0:7469:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782224130.689227:0:7469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782224130.689228:0:7469:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782224130.689233:0:7469:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1782224130.689236:0:7469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782224130.689237:0:7469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782224130.689239:0:7469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782224130.689240:0:7469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782224130.689241:0:7469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782224130.689242:0:7469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782224130.689243:0:7469:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782224130.689244:0:7469:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782224130.689245:0:7469:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782224130.689246:0:7469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782224130.689247:0:7469:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782224130.689272:0:7469:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1782224130.689290:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332965120:0@lo:253: 00000100:00100000:0.0:1782224130.689346:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224130.689392:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea882c8180 going to sleep for 11 seconds 00000100:00100000:0.0:1782224130.689413:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332965120 00000100:00100000:0.0:1782224130.689419:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332965120 00000100:00100000:0.0:1782224130.689467:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1782224130.689483:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+14:7469:x1868797332965120:12345-0@lo:253: 20000000:01000000:0.0:1782224130.689536:0:5780:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1782224130.690049:0:5780:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1782224130.772125:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1782224130.780693:0:5780:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782224130.780755:0:5780:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1782224130.785961:0:5802:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782224130.785973:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1782224130.787111:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96ea90674a00/0xcfd8b3ae4b16481c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224130.787140:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea80031600/0xcfd8b3ae4b16476d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164766 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224130.787152:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96ea90674a00/0xcfd8b3ae4b16481c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224130.787204:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea80031600/0xcfd8b3ae4b16476d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b164766 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224130.787222:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96ea80031600/0xcfd8b3ae4b16476d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164766 expref: 14 pid: 5780 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224130.787239:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5802:1868797332965248:0@lo:104: 00000100:00100000:3.0:1782224130.787326:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224130.787383:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa7a0f480 going to sleep for 11 seconds 00000100:00100000:0.0:1782224130.788811:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332965248 00000100:00100000:0.0:1782224130.788831:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332965248 00000100:00100000:0.0:1782224130.788921:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782224130.788933:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b33607d9-62cb-4729-8187-59883763158a+3:5802:x1868797332965248:12345-0@lo:104: 00010000:00010000:0.0:1782224130.788954:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eabb611000/0xcfd8b3ae4b164766 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b16476d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.789130:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782224130.789137:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b33607d9-62cb-4729-8187-59883763158a+3:5802:x1868797332965248:12345-0@lo:104: Request processed in 207us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224130.789145:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1782224130.789175:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224130.789181:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabb611000/0xcfd8b3ae4b164766 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b16476d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.789189:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabb611000 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:0.0:1782224130.789194:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabb611000/0xcfd8b3ae4b164766 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b16476d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.789204:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabb611000/0xcfd8b3ae4b164766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b16476d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782224130.789212:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabb611000/0xcfd8b3ae4b164766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b16476d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782224130.789218:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782224130.789283:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabb611000/0xcfd8b3ae4b164766 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16476d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.789290:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782224130.789316:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabb611000/0xcfd8b3ae4b164766 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16476d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.789323:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabb611000/0xcfd8b3ae4b164766 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16476d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.789347:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224130.789349:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224130.789350:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224130.789378:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797332965376:0@lo:103: 00000100:00100000:0.0:1782224130.789429:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224130.789492:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332965376 00000100:00100000:0.0:1782224130.789496:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332965376 00010000:00010000:0.0:1782224130.789530:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea80031600/0xcfd8b3ae4b16476d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164766 expref: 15 pid: 5780 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224130.789685:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5802:1868797332965248:0@lo:104: 00010000:00010000:2.0:1782224130.789712:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96ea90674a00/0xcfd8b3ae4b16481c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224130.790746:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782224130.790763:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea860b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+15:3303:x1868797332965376:12345-0@lo:103: 00010000:00010000:0.0:1782224130.790783:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224130.790792:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea80031600/0xcfd8b3ae4b16476d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164766 expref: 15 pid: 5780 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.790808:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea80031600/0xcfd8b3ae4b16476d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164766 expref: 15 pid: 5780 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.790827:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea80031600/0xcfd8b3ae4b16476d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b164766 expref: 15 pid: 5780 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.790861:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96ea90674a00/0xcfd8b3ae4b16481c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.790869:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90674a00/0xcfd8b3ae4b16481c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782224130.790887:0:5770:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008647057s 00010000:00010000:0.0:1782224130.790893:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea90674a00/0xcfd8b3ae4b16481c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.790900:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea90674a00/0xcfd8b3ae4b16481c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.790906:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96ea90674a00/0xcfd8b3ae4b16481c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.790912:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96ea90674a00/0xcfd8b3ae4b16481c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.790918:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674a00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224130.790923:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96ea90674a00/0xcfd8b3ae4b16481c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.790932:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96ea90674a00/0xcfd8b3ae4b16481c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.790959:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96ea90674a00/0xcfd8b3ae4b16481c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224130.790970:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224130.791088:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea860b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+14:3303:x1868797332965376:12345-0@lo:103: Request processed in 330us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224130.791096:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782224130.791187:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797332965376:0@lo:103: 00010000:00010000:3.0:1782224130.792702:0:5802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96ea90674a00/0xcfd8b3ae4b16481c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224130.792721:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96ea90674a00/0xcfd8b3ae4b16481c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224130.792752:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90674a00/0xcfd8b3ae4b16481c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224130.822974:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+13:7469:x1868797332965120:12345-0@lo:253: Request processed in 133478us (133613us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224130.822993:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1782224130.823205:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b33607d9-62cb-4729-8187-59883763158a:7469:1868797332965120:0@lo:253: 10000000:01000000:0.0:1782224130.823223:0:7469:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1782224130.823227:0:7469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782224130.823229:0:7469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782224130.823230:0:7469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782224130.823231:0:7469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782224130.823233:0:7469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782224130.823234:0:7469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782224130.823236:0:7469:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782224130.823237:0:7469:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782224130.823239:0:7469:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782224130.823240:0:7469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782224130.823242:0:7469:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782224130.823270:0:7469:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782224130.833693:0:7469:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1782224130.834073:0:7469:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782224130.834319:0:7469:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1782224130.834489:0:7469:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1782224130.839340:0:7469:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1782224130.841229:0:7469:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1782224130.849649:0:7469:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1782224131.129621:0:7469:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1782224131.129631:0:7469:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1782224131.129690:0:7469:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782224131.129765:0:7469:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.107@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782224131.129785:0:7469:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1782224131.129820:0:7469:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1782224131.796151:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224132.821198:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224133.206374:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782224133.206852:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332965504:0@lo:13: 00000100:00100000:3.0:1782224133.211444:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224133.211645:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332965504 00000100:00100000:1.0:1782224133.211658:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332965504 00000100:00100000:1.0:1782224133.211732:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224133.211745:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332965504:12345-0@lo:13: 00002000:00000024:1.0:1782224133.211798:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224133.211858:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332965504:12345-0@lo:13: Request processed in 116us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224133.211866:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1782224133.211902:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782224133.212089:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea88af6a00 x1868797332965504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224133.212444:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332965504:0@lo:13: 00010000:00010000:2.0:1782224133.844197:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224134.874760:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224135.765976:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332965632:0@lo:400: 00000100:00100000:1.0:1782224135.766105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224135.766251:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332965632 00000100:00100000:3.0:1782224135.766261:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332965632 00000100:00100000:3.0:1782224135.766331:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782224135.766343:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:3305:x1868797332965632:12345-0@lo:400: 00000100:00100000:3.0:1782224135.773087:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:3305:x1868797332965632:12345-0@lo:400: Request processed in 6729us (6964us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224135.773107:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782224135.773251:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797332965760:0@lo:400: 00000100:00100000:3.0:1782224135.773324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224135.773395:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332965760 00000100:00100000:3.0:1782224135.773404:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332965760 00000100:00100000:3.0:1782224135.773449:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782224135.773457:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797332965760:12345-0@lo:400: 00000100:00100000:3.0:1782224135.773516:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797332965760:12345-0@lo:400: Request processed in 60us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224135.773523:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1782224135.773565:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea88af4e00 x1868797332965760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224135.773582:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797332965760:0@lo:400: 00000100:00100000:1.0:1782224135.773910:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332965632:0@lo:400: 00000100:00100000:1.0:1782224135.774281:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782224135.774336:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782224135.774347:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332966016:0@lo:400: 00000100:00100000:3.0:1782224135.774391:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224135.778180:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332966016 00000100:00100000:3.0:1782224135.778202:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332966016 00000100:00100000:3.0:1782224135.778312:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782224135.778325:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332966016:12345-0@lo:400: 00000100:00100000:3.0:1782224135.778450:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332966016:12345-0@lo:400: Request processed in 127us (4057us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224135.778459:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782224135.778522:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea88af6300 x1868797332966016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224135.778541:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332966016:0@lo:400: 00000100:00080000:1.0:1782224135.778838:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782224135.778856:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797332965888:0@lo:400: 00000100:00100000:1.0:1782224135.778905:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224135.779000:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332965888 00000100:00100000:3.0:1782224135.779005:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332965888 00000100:00100000:3.0:1782224135.779065:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782224135.779072:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797332965888:12345-0@lo:400: 00000100:00100000:3.0:1782224135.779122:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797332965888:12345-0@lo:400: Request processed in 50us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224135.779129:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1782224135.779196:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782224135.779216:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea88af5f80 x1868797332965888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224135.779228:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797332965888:0@lo:400: 00000100:00100000:3.0:1782224135.779487:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782224135.780582:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332966144:0@lo:400: 00000100:00100000:3.0:1782224135.780651:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224135.783603:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332966144 00000100:00100000:0.0:1782224135.783623:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332966144 00000100:00100000:0.0:1782224135.783888:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782224135.783902:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332966144:12345-0@lo:400: 00000100:00100000:0.0:1782224135.784068:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332966144:12345-0@lo:400: Request processed in 168us (3416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224135.784077:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1782224135.784149:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea88af5180 x1868797332966144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224135.784169:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332966144:0@lo:400: 00000100:00080000:1.0:1782224135.786578:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782224135.893414:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224136.921861:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224137.940341:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224138.334039:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782224138.334073:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332966272:0@lo:13: 00000100:00100000:1.0:1782224138.334170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224138.334257:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332966272 00000100:00100000:1.0:1782224138.334268:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332966272 00000100:00100000:1.0:1782224138.334332:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782224138.334343:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332966272:12345-0@lo:13: 00002000:00000024:1.0:1782224138.334388:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224138.334438:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332966272:12345-0@lo:13: Request processed in 96us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224138.334458:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1782224138.334492:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782224138.334528:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea83f51c00 x1868797332966272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224138.334550:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332966272:0@lo:13: 00000001:02000400:0.0:1782224138.787163:0:7825:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782224138.964899:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782224139.348407:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782224139.348438:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff96ea8341a800 from 30 10000000:01000000:0.0:1782224139.348454:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782224139.348513:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b164823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224139.348528:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b164823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224139.348542:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b164823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224139.348573:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332966400:0@lo:101: 00000100:00100000:0.0:1782224139.348669:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224139.348743:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782224139.348850:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332966400 00000100:00100000:3.0:1782224139.348860:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332966400 00000100:00100000:3.0:1782224139.348960:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782224139.348971:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+13:5783:x1868797332966400:12345-0@lo:101: 00010000:00010000:3.0:1782224139.348989:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224139.349005:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b16482a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b164823 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224139.349069:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b16482a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164823 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224139.349082:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b16482a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164823 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224139.349092:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675200, rc 0) 00000100:00100000:3.0:1782224139.349134:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+14:5783:x1868797332966400:12345-0@lo:101: Request processed in 164us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224139.349141:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782224139.349242:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332966400:0@lo:101: 00010000:00010000:0.0:1782224139.349268:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b164823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16482a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224139.349279:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b164823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b16482a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224139.349336:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332966528:0@lo:501: 00000100:00100000:0.0:1782224139.349364:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224139.349392:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782224139.349522:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332966528 00000100:00100000:1.0:1782224139.349536:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332966528 00000100:00100000:1.0:1782224139.349577:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782224139.349585:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+14:5783:x1868797332966528:12345-0@lo:501: 00000100:00100000:1.0:1782224139.350003:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+14:5783:x1868797332966528:12345-0@lo:501: Request processed in 418us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224139.350011:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782224139.350178:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332966528:0@lo:501: 00000100:00100000:0.0:1782224139.350208:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332966656:0@lo:503: 00000100:00100000:0.0:1782224139.350265:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224139.350290:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782224139.350375:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332966656 00000100:00100000:1.0:1782224139.350379:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332966656 00000100:00100000:1.0:1782224139.350464:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782224139.350472:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+14:5783:x1868797332966656:12345-0@lo:503: 00000100:00100000:1.0:1782224139.350763:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+14:5783:x1868797332966656:12345-0@lo:503: Request processed in 290us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224139.350770:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782224139.350985:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332966656:0@lo:503: 00000100:00100000:0.0:1782224139.351218:0:7847:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:7847:1868797332966784:0@lo:502: 00000100:00100000:0.0:1782224139.351268:0:7847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224139.355103:0:7847:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07840 going to sleep for 11 seconds 00000100:00100000:2.0:1782224139.356349:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332966784 00000100:00100000:2.0:1782224139.356365:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332966784 00000100:00100000:2.0:1782224139.356455:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782224139.356468:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+14:7847:x1868797332966784:12345-0@lo:502: 00000100:00100000:2.0:1782224139.356937:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+14:7847:x1868797332966784:12345-0@lo:502: Request processed in 471us (5667us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224139.356946:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782224139.357202:0:7847:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:7847:1868797332966784:0@lo:502: 00000100:00100000:0.0:1782224139.357284:0:7847:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:7847:1868797332966912:0@lo:502: 00000100:00100000:0.0:1782224139.357335:0:7847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224139.357371:0:7847:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07840 going to sleep for 11 seconds 00000100:00100000:2.0:1782224139.357440:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332966912 00000100:00100000:2.0:1782224139.357445:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332966912 00000100:00100000:2.0:1782224139.357467:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782224139.357473:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+14:7847:x1868797332966912:12345-0@lo:502: 00000100:00100000:2.0:1782224139.357633:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+14:7847:x1868797332966912:12345-0@lo:502: Request processed in 159us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224139.357640:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782224139.358113:0:7847:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:7847:1868797332966912:0@lo:502: 00000040:00080000:0.0:1782224139.358138:0:7847:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1782224139.358336:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1782224139.358359:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782224139.358379:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b164823 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16482a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224139.358391:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b164823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16482a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224139.358402:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1782224139.358405:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1782224139.358408:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782224139.358449:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90674a00/0xcfd8b3ae4b164831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224139.358458:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea90674a00/0xcfd8b3ae4b164831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224139.358470:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea90674a00/0xcfd8b3ae4b164831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224139.358485:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332967040:0@lo:101: 00000100:00100000:3.0:1782224139.358525:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224139.358557:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea89171300 going to sleep for 11 seconds 00000100:00100000:0.0:1782224139.358636:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332967040 00000100:00100000:0.0:1782224139.358641:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332967040 00000100:00100000:0.0:1782224139.358665:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782224139.358672:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+14:5783:x1868797332967040:12345-0@lo:101: 00010000:00010000:0.0:1782224139.358683:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224139.358699:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbb87800/0xcfd8b3ae4b164838 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b164831 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224139.358728:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbb87800/0xcfd8b3ae4b164838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164831 expref: 15 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224139.358738:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbb87800/0xcfd8b3ae4b164838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164831 expref: 15 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224139.358748:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbb87800, rc 0) 00000100:00100000:0.0:1782224139.358791:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:5783:x1868797332967040:12345-0@lo:101: Request processed in 119us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224139.358807:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1782224139.359246:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332967040:0@lo:101: 00010000:00010000:3.0:1782224139.359263:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea90674a00/0xcfd8b3ae4b164831 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164838 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224139.359273:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea90674a00/0xcfd8b3ae4b164831 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164838 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224139.359324:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332967168:0@lo:501: 00000100:00100000:3.0:1782224139.359364:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224139.359395:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea89171300 going to sleep for 11 seconds 00000100:00100000:0.0:1782224139.359572:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332967168 00000100:00100000:0.0:1782224139.359578:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332967168 00000100:00100000:0.0:1782224139.359610:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782224139.359618:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:5783:x1868797332967168:12345-0@lo:501: 00000100:00100000:0.0:1782224139.359928:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:5783:x1868797332967168:12345-0@lo:501: Request processed in 301us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224139.359936:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1782224139.360128:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332967168:0@lo:501: 00000100:00100000:3.0:1782224139.360161:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332967296:0@lo:503: 00000100:00100000:3.0:1782224139.360211:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224139.360291:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332967296 00000100:00100000:0.0:1782224139.360296:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332967296 00000100:00100000:0.0:1782224139.360329:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782224139.360336:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:5783:x1868797332967296:12345-0@lo:503: 00000100:00100000:0.0:1782224139.360668:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:5783:x1868797332967296:12345-0@lo:503: Request processed in 331us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224139.360674:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782224139.360897:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea89171300 going to sleep for 11 seconds 00000100:00100000:3.0:1782224139.360913:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332967296:0@lo:503: 00000100:00100000:3.0:1782224139.362047:0:7848:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:7848:1868797332967424:0@lo:502: 00000100:00100000:3.0:1782224139.362130:0:7848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224139.362164:0:7848:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea891263c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224139.362252:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332967424 00000100:00100000:0.0:1782224139.362259:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332967424 00000100:00100000:0.0:1782224139.362308:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1782224139.362318:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:7848:x1868797332967424:12345-0@lo:502: 00000100:00100000:0.0:1782224139.362613:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:7848:x1868797332967424:12345-0@lo:502: Request processed in 295us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224139.362621:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782224139.363005:0:7848:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:7848:1868797332967424:0@lo:502: 00000020:01000000:3.0:1782224139.363067:0:7848:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782224139.363077:0:7848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224139.363080:0:7848:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782224139.363089:0:7848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782224139.363091:0:7848:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1782224139.363111:0:7848:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:7848:1868797332967552:0@lo:502: 00000100:00100000:3.0:1782224139.363148:0:7848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224139.363166:0:7848:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea89171300 going to sleep for 11 seconds 00000100:00100000:0.0:1782224139.363229:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332967552 00000100:00100000:0.0:1782224139.363235:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332967552 00000100:00100000:0.0:1782224139.363307:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782224139.363316:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+15:7848:x1868797332967552:12345-0@lo:502: 00000100:00100000:0.0:1782224139.363490:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+15:7848:x1868797332967552:12345-0@lo:502: Request processed in 175us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224139.363497:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782224139.363559:0:7848:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:7848:1868797332967552:0@lo:502: 00000020:01000000:3.0:1782224139.363578:0:7848:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782224139.363582:0:7848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224139.363584:0:7848:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782224139.363588:0:7848:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1782224139.364994:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1782224139.365048:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1782224139.365064:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90674a00/0xcfd8b3ae4b164831 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164838 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224139.365077:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea90674a00/0xcfd8b3ae4b164831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164838 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782224139.365089:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782224139.365092:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff96ea982ae000 from 30 10000000:01000000:0.0:1782224139.365095:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782224139.365134:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb86000/0xcfd8b3ae4b16483f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224139.365142:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabbb86000/0xcfd8b3ae4b16483f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224139.365152:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabbb86000/0xcfd8b3ae4b16483f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224139.365318:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332967680:0@lo:101: 00000100:00100000:0.0:1782224139.365391:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224139.365585:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332967680 00000100:00100000:3.0:1782224139.365593:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332967680 00000100:00100000:0.0:1782224139.365595:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782224139.365645:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1782224139.365664:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+15:5783:x1868797332967680:12345-0@lo:101: 00010000:00010000:3.0:1782224139.365680:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224139.365695:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b164846 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b16483f expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224139.365721:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b164846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16483f expref: 16 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224139.365732:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b164846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16483f expref: 16 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224139.365740:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675600, rc 0) 00000100:00100000:3.0:1782224139.365779:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+16:5783:x1868797332967680:12345-0@lo:101: Request processed in 116us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224139.365786:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782224139.365805:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332967680:0@lo:101: 00010000:00010000:0.0:1782224139.365820:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabbb86000/0xcfd8b3ae4b16483f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164846 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224139.365842:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabbb86000/0xcfd8b3ae4b16483f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164846 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224139.365898:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332967808:0@lo:501: 00000100:00100000:0.0:1782224139.365933:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224139.365955:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782224139.366055:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332967808 00000100:00100000:3.0:1782224139.366059:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332967808 00000100:00100000:3.0:1782224139.366082:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782224139.366088:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+16:5783:x1868797332967808:12345-0@lo:501: 00000100:00100000:3.0:1782224139.366373:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+16:5783:x1868797332967808:12345-0@lo:501: Request processed in 284us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224139.366380:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782224139.366395:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332967808:0@lo:501: 00000100:00100000:0.0:1782224139.366421:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332967936:0@lo:503: 00000100:00100000:0.0:1782224139.366634:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224139.366664:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782224139.367337:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332967936 00000100:00100000:3.0:1782224139.367344:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332967936 00000100:00100000:3.0:1782224139.367393:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782224139.367402:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+16:5783:x1868797332967936:12345-0@lo:503: 00000100:00100000:3.0:1782224139.367593:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+16:5783:x1868797332967936:12345-0@lo:503: Request processed in 191us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224139.367610:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782224139.370305:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332967936:0@lo:503: 00000100:00100000:2.0:1782224139.371734:0:7849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf234700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:7849:1868797332968064:0@lo:502: 00000100:00100000:2.0:1782224139.371847:0:7849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224139.371902:0:7849:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc887480 going to sleep for 11 seconds 00000100:00100000:0.0:1782224139.371969:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332968064 00000100:00100000:0.0:1782224139.371977:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332968064 00000100:00100000:0.0:1782224139.372061:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782224139.372109:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+16:7849:x1868797332968064:12345-0@lo:502: 00000100:00100000:0.0:1782224139.372428:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+16:7849:x1868797332968064:12345-0@lo:502: Request processed in 320us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224139.372545:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782224139.372572:0:7849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf234700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:7849:1868797332968064:0@lo:502: 00000100:00100000:1.0:1782224139.372630:0:7849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:7849:1868797332968192:0@lo:502: 00000100:00100000:1.0:1782224139.372669:0:7849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224139.372750:0:7849:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaaa254300 going to sleep for 11 seconds 00000100:00100000:2.0:1782224139.385375:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332968192 00000100:00100000:2.0:1782224139.385399:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332968192 00000100:00100000:2.0:1782224139.385494:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782224139.385506:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+16:7849:x1868797332968192:12345-0@lo:502: 00000100:00100000:2.0:1782224139.385889:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+16:7849:x1868797332968192:12345-0@lo:502: Request processed in 385us (13220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224139.385898:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782224139.386122:0:7849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:7849:1868797332968192:0@lo:502: 00000040:00080000:3.0:1782224139.386169:0:7849:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1782224139.386367:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1782224139.386390:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782224139.386404:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb86000/0xcfd8b3ae4b16483f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164846 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224139.386416:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabbb86000/0xcfd8b3ae4b16483f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164846 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782224139.386442:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782224139.386445:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff96ea982ae000 from 5 10000000:01000000:0.0:1782224139.386448:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782224139.386492:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb87000/0xcfd8b3ae4b16484d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224139.386501:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabbb87000/0xcfd8b3ae4b16484d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224139.386511:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabbb87000/0xcfd8b3ae4b16484d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224139.386535:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332968320:0@lo:101: 00000100:00100000:0.0:1782224139.386594:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224139.386634:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782224139.387346:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332968320 00000100:00100000:2.0:1782224139.387356:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332968320 00000100:00100000:2.0:1782224139.389586:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782224139.389612:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+16:5783:x1868797332968320:12345-0@lo:101: 00010000:00010000:2.0:1782224139.389639:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224139.389665:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabb611000/0xcfd8b3ae4b164854 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b16484d expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224139.389703:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabb611000/0xcfd8b3ae4b164854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16484d expref: 17 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224139.389716:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabb611000/0xcfd8b3ae4b164854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16484d expref: 17 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224139.389729:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabb611000, rc 0) 00000100:00100000:2.0:1782224139.389842:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332968320:12345-0@lo:101: Request processed in 241us (3247us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224139.389850:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782224139.397351:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332968320:0@lo:101: 00010000:00010000:2.0:1782224139.397391:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabbb87000/0xcfd8b3ae4b16484d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164854 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224139.397406:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabbb87000/0xcfd8b3ae4b16484d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164854 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224139.397518:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf237b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332968448:0@lo:256: 00000100:00100000:2.0:1782224139.397603:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224139.397654:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc887180 going to sleep for 11 seconds 00000100:00100000:0.0:1782224139.397772:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332968448 00000100:00100000:0.0:1782224139.397781:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332968448 00000100:00100000:0.0:1782224139.397844:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782224139.397856:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332968448:12345-0@lo:256: 20000000:01000000:0.0:1782224139.397885:0:5779:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782224139.397906:0:5779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782224139.397910:0:5779:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1782224139.398083:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332968448:12345-0@lo:256: Request processed in 228us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224139.398091:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782224139.398197:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf237b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332968448:0@lo:256: 10000000:01000000:3.0:1782224139.398252:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782224139.398261:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb87000/0xcfd8b3ae4b16484d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164854 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224139.398270:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabbb87000/0xcfd8b3ae4b16484d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164854 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224139.398281:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782224139.398284:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1782224139.398287:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782224139.398320:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b16485b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224139.398327:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b16485b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224139.398337:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b16485b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224139.398350:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332968576:0@lo:101: 00000100:00100000:3.0:1782224139.398379:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224139.398412:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea89171c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782224139.398566:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332968576 00000100:00100000:0.0:1782224139.398571:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332968576 00000100:00100000:0.0:1782224139.398607:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782224139.398623:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332968576:12345-0@lo:101: 00010000:00010000:0.0:1782224139.398633:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224139.398648:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbb86c00/0xcfd8b3ae4b164862 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b16485b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224139.398670:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbb86c00/0xcfd8b3ae4b164862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16485b expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224139.398680:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbb86c00/0xcfd8b3ae4b164862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16485b expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224139.398690:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbb86c00, rc 0) 00000100:00100000:0.0:1782224139.398721:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332968576:12345-0@lo:101: Request processed in 99us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224139.398726:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782224139.398788:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332968576:0@lo:101: 00010000:00010000:3.0:1782224139.398808:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b16485b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224139.398816:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b16485b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224139.398864:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332968704:0@lo:501: 00000100:00100000:3.0:1782224139.398889:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224139.398910:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea89171c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782224139.398934:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332968704 00000100:00100000:3.0:1782224139.398937:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332968704 00000100:00100000:3.0:1782224139.398957:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782224139.398962:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332968704:12345-0@lo:501: 00000100:00100000:3.0:1782224139.399302:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332968704:12345-0@lo:501: Request processed in 337us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224139.399309:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782224139.399332:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332968704:0@lo:501: 00000100:00100000:3.0:1782224139.399360:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332968832:0@lo:503: 00000100:00100000:3.0:1782224139.399402:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224139.399411:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea89171c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782224139.399427:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332968832 00000100:00100000:3.0:1782224139.399431:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332968832 00000100:00100000:3.0:1782224139.399447:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782224139.399453:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332968832:12345-0@lo:503: 00000100:00100000:3.0:1782224139.401976:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332968832:12345-0@lo:503: Request processed in 2509us (2560us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224139.401994:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782224139.402116:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332968832:0@lo:503: 00000100:00100000:1.0:1782224139.408981:0:7850:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:7850:1868797332968960:0@lo:502: 00000100:00100000:1.0:1782224139.409345:0:7850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224139.409395:0:7850:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaaa2543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224139.409473:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332968960 00000100:00100000:2.0:1782224139.409492:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332968960 00000100:00100000:2.0:1782224139.409549:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1782224139.409559:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:7850:x1868797332968960:12345-0@lo:502: 00000100:00100000:2.0:1782224139.409912:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:7850:x1868797332968960:12345-0@lo:502: Request processed in 352us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224139.409930:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1782224139.410374:0:7850:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:7850:1868797332968960:0@lo:502: 00000020:01000000:1.0:1782224139.410415:0:7850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782224139.410426:0:7850:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1782224139.410436:0:7850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224139.410439:0:7850:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1782224139.410446:0:7850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782224139.410459:0:7850:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.107@tcp to nid 0x20000c0a8ca6b (192.168.202.107@tcp) 00000020:01000000:1.0:1782224139.410508:0:7850:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782224139.410512:0:7850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782224139.410543:0:7850:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff96ea83ef8000) 00000020:00000080:1.0:1782224139.410574:0:7850:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1782224139.410581:0:7850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782224139.410685:0:7850:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1782224139.410691:0:7850:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1782224139.410701:0:7850:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfd8b3ae4b164870 00010000:00080000:1.0:1782224139.410755:0:7850:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96eaa4803800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.107@tcp at head 00010000:00010000:1.0:1782224139.411346:0:7850:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1782224139.412740:0:7850:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1782224139.412764:0:7850:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1782224139.414626:0:7850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782224139.414907:0:7850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782224139.414980:0:7850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1782224139.416814:0:7850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1782224139.418906:0:7851:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782224139.418928:0:7851:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1782224139.421379:0:7850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782224139.421398:0:7850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782224139.421447:0:7850:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1782224139.421496:0:7850:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfd8b3ae4b164877 00000100:00080000:2.0:1782224139.421511:0:7850:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782224139.421520:0:7850:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96eaa4803800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:2.0:1782224139.421573:0:7850:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96eabf234000 x1868797332969088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782224139.421622:0:7850:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1782224139.421699:0:7850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782224139.421704:0:7850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224139.421706:0:7850:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1782224139.421709:0:7850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782224139.421714:0:7850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224139.421715:0:7850:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782224139.421718:0:7850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782224139.421720:0:7850:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1782224139.421755:0:7850:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf237100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:7850:1868797332969216:0@lo:502: 00000100:00100000:2.0:1782224139.421861:0:7850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224139.421906:0:7850:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc887000 going to sleep for 11 seconds 00000100:00100000:1.0:1782224139.422342:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797332969472:0@lo:400: 00000100:00100000:1.0:1782224139.422383:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224139.422411:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782224139.422417:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868797332969344:0@lo:400: 00000100:00100000:1.0:1782224139.422439:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224139.422464:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332969600:0@lo:400: 00000100:00100000:1.0:1782224139.422507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224139.422529:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782224139.422534:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332969728:0@lo:400: 00000100:00100000:1.0:1782224139.422569:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224139.422623:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332969600 00000100:00100000:1.0:1782224139.422631:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332969600 00000100:00100000:1.0:1782224139.422681:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224139.422693:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332969600:12345-0@lo:400: 00000100:00100000:1.0:1782224139.422751:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332969600:12345-0@lo:400: Request processed in 59us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224139.422758:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1782224139.422801:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea83f51c00 x1868797332969600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224139.422814:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332969600:0@lo:400: 00000100:00100000:0.0:1782224139.423042:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332969472 00000100:00100000:0.0:1782224139.423048:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332969472 00000100:00100000:0.0:1782224139.423087:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332969344 00000100:00100000:0.0:1782224139.423090:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332969344 00000100:00100000:0.0:1782224139.423103:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332969728 00000100:00100000:0.0:1782224139.423105:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332969728 00000100:00100000:0.0:1782224139.423120:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782224139.423128:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797332969472:12345-0@lo:400: 00000100:00100000:0.0:1782224139.423178:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797332969472:12345-0@lo:400: Request processed in 51us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224139.423184:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782224139.423196:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782224139.423201:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868797332969344:12345-0@lo:400: 00000100:00100000:0.0:1782224139.423228:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868797332969344:12345-0@lo:400: Request processed in 26us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224139.423241:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782224139.423253:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782224139.423260:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332969728:12345-0@lo:400: 00000100:00100000:0.0:1782224139.423296:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332969728:12345-0@lo:400: Request processed in 37us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224139.423302:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1782224139.423318:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782224139.423342:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea83f52300 x1868797332969344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224139.423353:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868797332969344:0@lo:400: 00010000:00080000:0.0:1782224139.423366:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea83f51f80 x1868797332969472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224139.423376:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797332969472:0@lo:400: 00010000:00080000:0.0:1782224139.423404:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea83f53100 x1868797332969728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224139.423413:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332969728:0@lo:400: 00000100:00100000:0.0:1782224139.423436:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332969216 00000100:00100000:0.0:1782224139.423439:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332969216 00000100:00100000:0.0:1782224139.423465:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782224139.423471:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+18:7850:x1868797332969216:12345-0@lo:502: 00000100:00100000:3.0:1782224139.424119:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797332969088:0@lo:8: 00000100:00100000:3.0:1782224139.424173:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224139.424265:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332969088 00000100:00100000:2.0:1782224139.424271:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332969088 00000100:00100000:2.0:1782224139.424293:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782224139.424300:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3302:x1868797332969088:12345-0@lo:8: 00010000:00080000:2.0:1782224139.424327:0:6585:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:2.0:1782224139.424358:0:6585:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfd8b3ae4b16487e 00002000:00100000:2.0:1782224139.424372:0:6585:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff96eabc602000 ocd_connect_flags: 0xe044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1782224139.424377:0:6585:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1782224139.424381:0:6585:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1782224139.424533:0:6585:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1782224139.424914:0:6585:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782224139.424955:0:6585:0:(import.c:65:import_set_state_nolock()) ffff96eabc600000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782224139.425051:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1868797332969088:12345-0@lo:8: Request processed in 750us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224139.425059:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1782224139.425338:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabf234000 x1868797332969088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782224149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224139.425350:0:3302:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782224139.425359:0:3302:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1782224139.425368:0:3302:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xe040401443000026 00000100:00080000:3.0:1782224139.425374:0:3302:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1782224139.425377:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96eaa4803800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1782224139.425395:0:3302:0:(osp_dev.c:1650:osp_import_event()) got connected 00000100:00100000:3.0:1782224139.425400:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797332969088:0@lo:8: 00000100:00100000:0.0:1782224139.425863:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+18:7850:x1868797332969216:12345-0@lo:502: Request processed in 2390us (4000us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224139.425872:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000004:00080000:2.0:1782224139.426082:0:7851:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1782224139.426245:0:7851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 220206228983ns, next at 0ns, rc = 0 00000100:00100000:1.0:1782224139.426317:0:7850:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf237100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:7850:1868797332969216:0@lo:502: 00000020:01000000:1.0:1782224139.426352:0:7850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782224139.426360:0:7850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224139.426363:0:7850:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782224139.426372:0:7850:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1782224139.426614:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1782224139.426636:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782224139.426649:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b16485b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224139.426661:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b16485b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224139.426672:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782224139.426675:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff96ea833bcd40 from 1 10000000:01000000:3.0:1782224139.426678:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782224139.426715:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224139.426722:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224139.426746:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224139.426771:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332969856:0@lo:101: 00000100:00100000:3.0:1782224139.426815:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224139.426859:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea89171c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782224139.427201:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332969856 00000100:00100000:1.0:1782224139.427208:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332969856 00000100:00100000:1.0:1782224139.428007:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1782224139.428036:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332969856:12345-0@lo:101: 00010000:00010000:1.0:1782224139.428057:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224139.428076:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b16488c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b164885 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224139.428123:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b16488c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164885 expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224139.428135:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b16488c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164885 expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224139.428161:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99876c00, rc 0) 00000100:00100000:1.0:1782224139.428256:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797332969856:12345-0@lo:101: Request processed in 239us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224139.428264:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782224139.428374:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332969856:0@lo:101: 00010000:00010000:0.0:1782224139.428403:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164885 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16488c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224139.428413:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164885 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b16488c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224139.428488:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332969984:0@lo:501: 00000100:00100000:0.0:1782224139.428529:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224139.432962:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a076c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782224139.440079:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332969984 00000100:00100000:3.0:1782224139.440098:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332969984 00000100:00100000:3.0:1782224139.440188:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782224139.440200:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797332969984:12345-0@lo:501: 00000100:00100000:3.0:1782224139.444367:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797332969984:12345-0@lo:501: Request processed in 4152us (15820us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782224139.444389:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782224139.444794:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332969984:0@lo:501: 10000000:01000000:3.0:1782224139.444843:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782224139.444857:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164885 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16488c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224139.444870:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16488c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782224139.511904:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1782224139.512108:0:7852:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1782224139.512145:0:7852:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7852:1868797332970240:0@lo:7: 00000100:00100000:3.0:1782224139.512234:0:7852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224139.512292:0:7852:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea904f2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782224139.512346:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782224139.512362:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332970112:0@lo:13: 00000100:00100000:0.0:1782224139.512413:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224139.512617:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332970112 00000100:00100000:3.0:1782224139.512641:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332970112 00000100:00100000:3.0:1782224139.513603:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782224139.513620:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1868797332970112:12345-0@lo:13: 00002000:00000024:3.0:1782224139.513667:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1782224139.513741:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1868797332970112:12345-0@lo:13: Request processed in 126us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224139.513749:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782224139.515583:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332970240 00000100:00100000:1.0:1782224139.515602:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332970240 00000100:00100000:1.0:1782224139.515680:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782224139.515692:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7852:x1868797332970240:12345-0@lo:7: 00010000:00080000:0.0:1782224139.518089:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eaa7a0a680 x1868797332970112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224139.518123:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332970112:0@lo:13: 00000100:00080000:2.0:1782224139.518356:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1782224139.534962:0:6715:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1782224139.534974:0:6715:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1782224139.536791:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7852:x1868797332970240:12345-0@lo:7: Request processed in 21086us (24541us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224139.536811:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1782224139.537407:0:7852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eaa7a09180 x1868797332970240/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782224155 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224139.537428:0:7852:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7852:1868797332970240:0@lo:7: 00000004:00080000:1.0:1782224139.537465:0:7852:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1782224139.537526:0:7852:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7852:1868797332970368:0@lo:5: 00000100:00100000:1.0:1782224139.537594:0:7852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224139.537654:0:7852:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea882c83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224139.537988:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332970368 00000100:00100000:2.0:1782224139.537997:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332970368 00000100:00100000:2.0:1782224139.538079:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782224139.538090:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7852:x1868797332970368:12345-0@lo:5: 00002000:00080000:2.0:1782224139.538126:0:6585:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1782224139.538130:0:6585:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1782224139.545239:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7852:x1868797332970368:12345-0@lo:5: Request processed in 7132us (7627us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1782224139.545260:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1782224139.545945:0:7852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc88ca80 x1868797332970368/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782224155 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224139.545970:0:7852:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7852:1868797332970368:0@lo:5: 00000004:00080000:1.0:1782224139.545989:0:7852:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1782224139.546072:0:7852:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7852:1868797332970496:0@lo:700: 00000100:00100000:1.0:1782224139.546144:0:7852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224139.546188:0:7852:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea882c83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224139.546607:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332970496 00000100:00100000:2.0:1782224139.546616:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332970496 00000100:00100000:2.0:1782224139.546680:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782224139.546692:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7852:x1868797332970496:12345-0@lo:700: 00000100:00100000:2.0:1782224139.546744:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf234380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6591:1868797332970624:0@lo:700: 00000100:00100000:2.0:1782224139.546791:0:6591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224139.546819:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc8876c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224139.546867:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332970624 00000100:00100000:0.0:1782224139.546871:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332970624 00000100:00100000:0.0:1782224139.546912:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782224139.546931:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6591:x1868797332970624:12345-0@lo:700: 40000000:02000000:0.0:1782224139.646434:0:5793:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1782224139.663108:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6591:x1868797332970624:12345-0@lo:700: Request processed in 116168us (116306us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224139.663129:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782224139.663221:0:6591:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabf234380 x1868797332970624/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782224155 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224139.663238:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf234380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6591:1868797332970624:0@lo:700: 40000000:02000000:0.0:1782224139.663263:0:6591:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1782224139.812471:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1782224139.812492:0:7486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1782224139.812871:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7852:x1868797332970496:12345-0@lo:700: Request processed in 266174us (266720us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224139.812885:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782224139.812893:0:7852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc88f100 x1868797332970496/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782224155 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224139.812906:0:7852:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1782224139.812936:0:7852:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7852:1868797332970496:0@lo:700: 00000004:02000040:0.0:1782224139.854269:0:7852:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1782224139.869412:0:7852:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7852:1868797332970752:0@lo:5: 00000100:00100000:0.0:1782224139.870690:0:7852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224139.870764:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332970752 00000100:00100000:0.0:1782224139.870773:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332970752 00000100:00100000:0.0:1782224139.870829:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782224139.870840:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7852:x1868797332970752:12345-0@lo:5: 00000100:00100000:1.0:1782224139.874131:0:7852:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaaa2570c0 going to sleep for 11 seconds 00002000:00080000:1.0:1782224139.898758:0:6582:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1782224139.898793:0:6582:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1782224139.918318:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7852:x1868797332970752:12345-0@lo:5: Request processed in 47464us (47618us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1782224139.918335:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1782224139.918514:0:7852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea88af4a80 x1868797332970752/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782224155 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224139.918537:0:7852:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7852:1868797332970752:0@lo:5: 00000004:00080000:3.0:1782224139.918556:0:7852:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1782224139.988323:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224141.012442:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224142.041739:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224143.071229:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224143.444472:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332970880:0@lo:13: 00000100:00100000:0.0:1782224143.444554:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224143.444793:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332970880 00000100:00100000:1.0:1782224143.444803:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332970880 00000100:00100000:1.0:1782224143.444875:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782224143.444897:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332970880:12345-0@lo:13: 00002000:00000024:1.0:1782224143.444935:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224143.444984:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332970880:12345-0@lo:13: Request processed in 90us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224143.444991:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1782224143.445053:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc88c000 x1868797332970880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224143.445071:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332970880:0@lo:13: 00000100:00080000:0.0:1782224143.445153:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782224144.084212:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782224144.368733:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1782224144.470346:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332971264:0@lo:400: 00000100:00100000:2.0:1782224144.470442:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224144.470498:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224144.470505:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332971392:0@lo:400: 00000100:00100000:2.0:1782224144.470533:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224144.470671:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332971008:0@lo:400: 00000100:00100000:1.0:1782224144.470710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224144.470742:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332971520:0@lo:400: 00000100:00100000:1.0:1782224144.470765:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224144.470784:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782224144.470789:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797332971136:0@lo:400: 00000100:00100000:1.0:1782224144.470810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224144.470824:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332971648:0@lo:400: 00000100:00100000:1.0:1782224144.470843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224144.470891:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332971264 00000100:00100000:1.0:1782224144.470898:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332971264 00000100:00100000:1.0:1782224144.470973:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332971520 00000100:00100000:1.0:1782224144.470976:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332971520 00000100:00100000:1.0:1782224144.470988:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332971136 00000100:00100000:1.0:1782224144.470991:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332971136 00000100:00100000:1.0:1782224144.471003:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782224144.471010:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332971264:12345-0@lo:400: 00000100:00100000:1.0:1782224144.471120:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332971264:12345-0@lo:400: Request processed in 109us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224144.471127:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782224144.471144:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782224144.471150:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332971520:12345-0@lo:400: 00000100:00100000:1.0:1782224144.471179:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332971520:12345-0@lo:400: Request processed in 30us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224144.471185:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782224144.471195:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782224144.471201:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797332971136:12345-0@lo:400: 00000100:00100000:1.0:1782224144.471226:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797332971136:12345-0@lo:400: Request processed in 25us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224144.471231:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782224144.471250:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332971392 00000100:00100000:1.0:1782224144.471254:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332971392 00000100:00100000:1.0:1782224144.471277:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332971648 00000100:00100000:1.0:1782224144.471280:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332971648 00000100:00100000:1.0:1782224144.471299:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782224144.471306:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332971392:12345-0@lo:400: 00000100:00100000:1.0:1782224144.471336:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332971392:12345-0@lo:400: Request processed in 30us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224144.471342:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782224144.471361:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782224144.471368:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332971648:12345-0@lo:400: 00000100:00100000:1.0:1782224144.471395:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332971648:12345-0@lo:400: Request processed in 29us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224144.471401:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1782224144.471415:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782224144.471420:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782224144.471586:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabf236300 x1868797332971392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224144.471600:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332971392:0@lo:400: 00010000:00080000:1.0:1782224144.471612:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabf235f80 x1868797332971264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224144.471620:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332971264:0@lo:400: 00010000:00080000:1.0:1782224144.471664:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabf236a00 x1868797332971136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224144.471673:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797332971136:0@lo:400: 00010000:00080000:1.0:1782224144.471682:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabf235180 x1868797332971648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224144.471688:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1782224144.471699:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332971648:0@lo:400: 00010000:00080000:1.0:1782224144.471708:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabf235500 x1868797332971520/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224144.471716:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332971520:0@lo:400: 00000100:00100000:2.0:1782224144.472665:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332971008 00000100:00100000:2.0:1782224144.472674:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332971008 00000100:00100000:2.0:1782224144.472726:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1782224144.472736:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332971008:12345-0@lo:400: 00000100:00100000:2.0:1782224144.472805:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332971008:12345-0@lo:400: Request processed in 71us (2094us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224144.472812:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782224144.474796:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332971008:0@lo:400: 00000100:00100000:2.0:1782224144.902684:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224144.902781:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311975552 00000100:00100000:0.0:1782224144.902792:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311975552 00000100:00100000:0.0:1782224144.902840:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 113 00000100:00100000:0.0:1782224144.902848:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2345:x1868797311975552:12345-192.168.202.7@tcp:250: 00010000:00080000:0.0:1782224144.902887:0:5780:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 4fff53da-03fa-4566-9f6c-b379e18824a7@192.168.202.7@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:0.0:1782224144.902915:0:5780:0:(genops.c:1406:class_connect()) connect: client 4fff53da-03fa-4566-9f6c-b379e18824a7, cookie 0xcfd8b3ae4b164893 00000100:00080000:0.0:1782224144.903114:0:5780:0:(import.c:65:import_set_state_nolock()) ffff96eabf839000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782224144.903188:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+5:2345:x1868797311975552:12345-192.168.202.7@tcp:250: Request processed in 339us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224144.903220:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 113 00000100:00100000:2.0:1782224144.909545:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224144.909632:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311975680 00000100:00100000:3.0:1782224144.909642:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311975680 00000100:00100000:3.0:1782224144.909693:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 114 00000100:00100000:3.0:1782224144.909702:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+5:5551:x1868797311975680:12345-192.168.202.7@tcp:101: 00010000:00010000:3.0:1782224144.909720:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224144.909753:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b16489a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51442 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224144.909785:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b16489a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51442 expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224144.909797:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b16489a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51442 expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224144.909808:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674800, rc 0) 00000100:00100000:3.0:1782224144.909918:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+6:5551:x1868797311975680:12345-192.168.202.7@tcp:101: Request processed in 216us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224144.909926:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 114 00000100:00100000:2.0:1782224144.921686:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224144.921781:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311975808 00000100:00100000:3.0:1782224144.921792:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311975808 00000100:00100000:3.0:1782224144.921852:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 115 00000100:00100000:3.0:1782224144.921863:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+6:5551:x1868797311975808:12345-192.168.202.7@tcp:501: 00000100:00100000:3.0:1782224144.922389:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+6:5551:x1868797311975808:12345-192.168.202.7@tcp:501: Request processed in 520us (704us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782224144.922398:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 115 00000100:00100000:2.0:1782224144.924776:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224144.926149:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311975936 00000100:00100000:3.0:1782224144.926162:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311975936 00000100:00100000:3.0:1782224144.926228:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 116 00000100:00100000:3.0:1782224144.926240:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+6:5551:x1868797311975936:12345-192.168.202.7@tcp:101: 00010000:00010000:3.0:1782224144.926258:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224144.926278:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea90674200/0xcfd8b3ae4b1648a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51449 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224144.926341:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90674200/0xcfd8b3ae4b1648a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51449 expref: 7 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224144.926353:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea90674200/0xcfd8b3ae4b1648a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51449 expref: 7 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224144.926370:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674200, rc 0) 00000100:00100000:3.0:1782224144.926441:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+7:5551:x1868797311975936:12345-192.168.202.7@tcp:101: Request processed in 203us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224144.926449:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 116 00000100:00100000:2.0:1782224144.939794:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224144.939837:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311976064 00000100:00100000:2.0:1782224144.939848:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311976064 00000100:00100000:2.0:1782224144.939913:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 117 00000100:00100000:2.0:1782224144.939924:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+7:5551:x1868797311976064:12345-192.168.202.7@tcp:501: 00000100:00100000:2.0:1782224144.940208:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+8:5551:x1868797311976064:12345-192.168.202.7@tcp:501: Request processed in 284us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224144.940218:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 117 00000100:00100000:3.0:1782224144.941912:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224144.945338:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311976192 00000100:00100000:2.0:1782224144.945353:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311976192 00000100:00100000:2.0:1782224144.945447:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 118 00000100:00100000:2.0:1782224144.945457:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+8:5551:x1868797311976192:12345-192.168.202.7@tcp:503: 00000100:00100000:2.0:1782224144.945832:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+8:5551:x1868797311976192:12345-192.168.202.7@tcp:503: Request processed in 375us (3928us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224144.945840:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 118 00000100:00100000:2.0:1782224144.951687:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224144.951923:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311976320 00000100:00100000:3.0:1782224144.951934:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311976320 00000100:00100000:3.0:1782224144.952407:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 119 00000100:00100000:3.0:1782224144.953047:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+8:5570:x1868797311976320:12345-192.168.202.7@tcp:502: 00000100:00100000:3.0:1782224144.954131:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+8:5570:x1868797311976320:12345-192.168.202.7@tcp:502: Request processed in 1705us (2445us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224144.954144:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 119 00000100:00100000:2.0:1782224144.979841:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224144.979940:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311976448 00000100:00100000:2.0:1782224144.980325:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332971776:0@lo:13: 00000100:00100000:2.0:1782224144.980407:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224144.980435:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332971776 00000100:00100000:1.0:1782224144.980443:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332971776 00000100:00100000:1.0:1782224144.980501:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782224144.980512:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332971776:12345-0@lo:13: 00002000:00000024:1.0:1782224144.980551:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224144.980599:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332971776:12345-0@lo:13: Request processed in 88us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224144.980606:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1782224144.980675:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea88af7b80 x1868797332971776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224144.980696:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332971776:0@lo:13: 00000100:00100000:3.0:1782224144.984511:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311976448 00000100:00100000:3.0:1782224144.984616:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 120 00000100:00100000:3.0:1782224144.984625:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+8:5570:x1868797311976448:12345-192.168.202.7@tcp:502: 00000100:00100000:3.0:1782224144.984932:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+8:5570:x1868797311976448:12345-192.168.202.7@tcp:502: Request processed in 306us (5099us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224144.984940:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 120 00000100:00100000:0.0:1782224144.997778:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224144.999147:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311976576 00000100:00100000:3.0:1782224144.999160:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311976576 00000100:00100000:3.0:1782224144.999235:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 121 00000100:00100000:3.0:1782224144.999246:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+8:5551:x1868797311976576:12345-192.168.202.7@tcp:101: 00010000:00010000:3.0:1782224144.999264:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224144.999283:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea90675400/0xcfd8b3ae4b1648a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51473 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224144.999314:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90675400/0xcfd8b3ae4b1648a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51473 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224144.999326:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea90675400/0xcfd8b3ae4b1648a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51473 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224144.999337:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675400, rc 0) 00000100:00100000:3.0:1782224145.000059:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+9:5551:x1868797311976576:12345-192.168.202.7@tcp:101: Request processed in 177us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224145.000069:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 121 00000100:00100000:1.0:1782224145.026860:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224145.028321:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311976704 00000100:00100000:3.0:1782224145.028335:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311976704 00000100:00100000:3.0:1782224145.028415:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 122 00000100:00100000:3.0:1782224145.028438:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+9:5551:x1868797311976704:12345-192.168.202.7@tcp:256: 20000000:01000000:3.0:1782224145.028468:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1782224145.028493:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1782224145.028499:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1782224145.028502:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1782224145.028506:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1782224145.035903:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+9:5551:x1868797311976704:12345-192.168.202.7@tcp:256: Request processed in 7454us (9037us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224145.035938:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 122 00000100:00100000:0.0:1782224145.047943:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224145.048044:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311976832 00000100:00100000:3.0:1782224145.048055:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311976832 00000100:00100000:3.0:1782224145.048115:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 123 00000100:00100000:3.0:1782224145.048128:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+9:5551:x1868797311976832:12345-192.168.202.7@tcp:101: 00010000:00010000:3.0:1782224145.048148:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224145.048166:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea90675800/0xcfd8b3ae4b1648af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5147a expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224145.048210:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90675800/0xcfd8b3ae4b1648af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5147a expref: 10 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224145.048222:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea90675800/0xcfd8b3ae4b1648af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5147a expref: 10 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224145.048232:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675800, rc 0) 00000100:00100000:3.0:1782224145.048295:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+10:5551:x1868797311976832:12345-192.168.202.7@tcp:101: Request processed in 170us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224145.048302:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 123 00000100:00100000:0.0:1782224145.054833:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224145.054942:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311976960 00000100:00100000:3.0:1782224145.054953:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311976960 00000100:00100000:3.0:1782224145.055047:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 124 00000100:00100000:3.0:1782224145.055059:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+10:5551:x1868797311976960:12345-192.168.202.7@tcp:501: 00000100:00100000:3.0:1782224145.055700:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+10:5551:x1868797311976960:12345-192.168.202.7@tcp:501: Request processed in 640us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224145.055711:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 124 00000100:00100000:2.0:1782224145.058771:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224145.059191:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311977088 00000100:00100000:3.0:1782224145.059219:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311977088 00000100:00100000:3.0:1782224145.059277:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 125 00000100:00100000:3.0:1782224145.059287:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+10:5551:x1868797311977088:12345-192.168.202.7@tcp:503: 00000100:00100000:3.0:1782224145.059965:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+10:5551:x1868797311977088:12345-192.168.202.7@tcp:503: Request processed in 676us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224145.059973:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 125 00000100:00100000:2.0:1782224145.075470:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224145.075559:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311977216 00000100:00100000:3.0:1782224145.075569:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311977216 00000100:00100000:3.0:1782224145.075630:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 126 00000100:00100000:3.0:1782224145.075641:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+10:5574:x1868797311977216:12345-192.168.202.7@tcp:502: 00000100:00100000:3.0:1782224145.075955:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+10:5574:x1868797311977216:12345-192.168.202.7@tcp:502: Request processed in 314us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224145.075964:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 126 00000100:00100000:2.0:1782224145.078764:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224145.078843:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311977344 00000100:00100000:3.0:1782224145.078855:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311977344 00000100:00100000:3.0:1782224145.078931:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 127 00000100:00100000:3.0:1782224145.078941:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+10:5574:x1868797311977344:12345-192.168.202.7@tcp:502: 00000100:00100000:2.0:1782224145.083597:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+10:5574:x1868797311977344:12345-192.168.202.7@tcp:502: Request processed in 4642us (4828us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224145.083614:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 127 00000100:00100000:2.0:1782224145.088592:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224145.088791:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311977472 00000100:00100000:0.0:1782224145.088801:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311977472 00000100:00100000:0.0:1782224145.088850:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:0.0:1782224145.088859:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2345:x1868797311977472:12345-192.168.202.7@tcp:38: 00010000:00080000:0.0:1782224145.088899:0:6605:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:0.0:1782224145.088947:0:6605:0:(genops.c:1406:class_connect()) connect: client 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39, cookie 0xcfd8b3ae4b1648b6 00000004:00100000:0.0:1782224145.088975:0:6605:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:0.0:1782224145.088980:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1782224145.117062:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782224145.189396:0:6605:0:(import.c:65:import_set_state_nolock()) ffff96eabf83d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782224145.189480:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2345:x1868797311977472:12345-192.168.202.7@tcp:38: Request processed in 100619us (100896us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224145.189493:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:3.0:1782224145.972496:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224145.972554:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224145.972669:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311977600 00000100:00100000:0.0:1782224145.972681:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311977600 00000100:00100000:0.0:1782224145.972766:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311977728 00000100:00100000:0.0:1782224145.972770:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311977728 00000100:00100000:0.0:1782224145.972797:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:0.0:1782224145.972807:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:0:x1868797311977600:12345-192.168.202.7@tcp:41: 00000100:00100000:1.0:1782224145.972835:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:1.0:1782224145.972844:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:5551:x1868797311977728:12345-192.168.202.7@tcp:41: 00000004:00000024:1.0:1782224145.972868:0:5787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000004:00000024:0.0:1782224145.972868:0:5786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1782224145.973044:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782224145.973144:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:0:x1868797311977600:12345-192.168.202.7@tcp:41: Request processed in 337us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224145.973153:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:1.0:1782224145.976475:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:5551:x1868797311977728:12345-192.168.202.7@tcp:41: Request processed in 3616us (3903us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224145.976492:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:0.0:1782224145.985064:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224145.985249:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311977856 00000100:00100000:3.0:1782224145.985259:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311977856 00000100:00100000:3.0:1782224145.985329:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:3.0:1782224145.985338:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:5551:x1868797311977856:12345-192.168.202.7@tcp:40: 00000100:00100000:3.0:1782224145.985440:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:5551:x1868797311977856:12345-192.168.202.7@tcp:40: Request processed in 102us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224145.985447:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:2.0:1782224145.990469:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224145.990581:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311978112 00000100:00100000:3.0:1782224145.990591:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311978112 00000100:00100000:3.0:1782224145.990651:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 128 00000100:00100000:3.0:1782224145.990661:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea90c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2348:x1868797311978112:12345-192.168.202.7@tcp:400: 00000100:00100000:3.0:1782224145.990750:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea90c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2348:x1868797311978112:12345-192.168.202.7@tcp:400: Request processed in 90us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224145.990758:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 128 00000100:00100000:2.0:1782224145.995972:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224145.996054:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224145.996107:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224145.996316:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311978368 00000100:00100000:0.0:1782224145.996328:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311978368 00000100:00100000:0.0:1782224145.996399:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:0.0:1782224145.996410:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:5551:x1868797311978368:12345-192.168.202.7@tcp:33: 00000100:00100000:1.0:1782224145.998171:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311977984 00000100:00100000:1.0:1782224145.998192:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311977984 00000100:00100000:1.0:1782224145.998234:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311978240 00000100:00100000:1.0:1782224145.998237:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311978240 00000100:00100000:1.0:1782224145.998264:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:1.0:1782224145.998272:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1868797311977984:12345-192.168.202.7@tcp:8: 00010000:00080000:1.0:1782224145.998302:0:6585:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:1.0:1782224145.998337:0:6585:0:(genops.c:1406:class_connect()) connect: client 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39, cookie 0xcfd8b3ae4b1648bd 00002000:00100000:1.0:1782224145.998349:0:6585:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39/ffff96eaa4802800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782224145.998376:0:6585:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1782224145.998726:0:6585:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782224145.998760:0:6585:0:(import.c:65:import_set_state_nolock()) ffff96eaa4806800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782224145.998830:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2345:x1868797311977984:12345-192.168.202.7@tcp:8: Request processed in 557us (2868us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224145.998838:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:1.0:1782224145.998870:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:1.0:1782224145.998875:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1868797311978240:12345-192.168.202.7@tcp:8: 00010000:00080000:1.0:1782224145.998892:0:6585:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:1.0:1782224145.998909:0:6585:0:(genops.c:1406:class_connect()) connect: client 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39, cookie 0xcfd8b3ae4b1648c4 00002000:00100000:1.0:1782224145.998915:0:6585:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39/ffff96eaa4802000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782224145.998921:0:6585:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1782224145.999189:0:6585:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782224145.999205:0:6585:0:(import.c:65:import_set_state_nolock()) ffff96eaa4807800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782224145.999230:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2345:x1868797311978240:12345-192.168.202.7@tcp:8: Request processed in 354us (3176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224145.999237:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00000004:00080000:0.0:1782224146.027299:0:5789:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30814us 00000004:00200000:0.0:1782224146.036252:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1782224146.036441:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:5551:x1868797311978368:12345-192.168.202.7@tcp:33: Request processed in 40026us (40326us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224146.036453:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 0 00010000:00010000:2.0:1782224146.132210:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224146.241308:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224146.241402:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311978496 00000100:00100000:0.0:1782224146.241415:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311978496 00000100:00100000:0.0:1782224146.241520:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:0.0:1782224146.241529:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:5591:x1868797311978496:12345-192.168.202.7@tcp:101: 00010000:00010000:0.0:1782224146.241548:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224146.241722:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b1648cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a514a4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224146.241817:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87e00/0xcfd8b3ae4b1648d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224146.241834:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87e00/0xcfd8b3ae4b1648d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224146.241849:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87e00/0xcfd8b3ae4b1648d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224146.242436:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1782224146.242448:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782224146.242961:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87e00/0xcfd8b3ae4b1648d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224146.243006:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b1648cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514a4 expref: 8 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224146.243054:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87e00/0xcfd8b3ae4b1648d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514a4 expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224146.243065:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96eaa7d65700) 00010000:00010000:0.0:1782224146.243068:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782224146.243072:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbb87e00, rc 0) 00000100:00100000:0.0:1782224146.243235:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:5591:x1868797311978496:12345-192.168.202.7@tcp:101: Request processed in 1695us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224146.243245:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 8 00010000:00010000:1.0:1782224147.157282:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224148.180254:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224148.564455:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224148.564491:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332971904:0@lo:13: 00000100:00100000:2.0:1782224148.564593:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224148.565707:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332971904 00000100:00100000:1.0:1782224148.565723:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332971904 00000100:00100000:1.0:1782224148.565839:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782224148.565853:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332971904:12345-0@lo:13: 00002000:00000024:1.0:1782224148.565926:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224148.566055:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332971904:12345-0@lo:13: Request processed in 205us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224148.566062:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1782224148.566131:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc88f800 x1868797332971904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224164 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224148.566161:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332971904:0@lo:13: 00000100:00080000:2.0:1782224148.566244:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782224148.791410:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224148.791621:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311978624 00000100:00100000:3.0:1782224148.791637:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311978624 00000100:00100000:3.0:1782224148.791874:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:3.0:1782224148.791888:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:5644:x1868797311978624:12345-192.168.202.7@tcp:41: 00000004:00000024:3.0:1782224148.791935:0:5788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1782224148.792069:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:5644:x1868797311978624:12345-192.168.202.7@tcp:41: Request processed in 182us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224148.792077:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00080000:2.0:1782224148.792225:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224148.795723:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224148.795841:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311978752 00000100:00100000:1.0:1782224148.795858:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311978752 00000100:00100000:1.0:1782224148.795966:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:1.0:1782224148.795985:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:5644:x1868797311978752:12345-192.168.202.7@tcp:13: 00000100:00080000:2.0:1782224148.796045:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1782224148.796068:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224148.796167:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:5644:x1868797311978752:12345-192.168.202.7@tcp:13: Request processed in 189us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224148.796176:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:1.0:1782224148.801998:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224148.802301:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311978880 00000100:00100000:3.0:1782224148.802312:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311978880 00000100:00100000:3.0:1782224148.802575:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:3.0:1782224148.802587:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:5644:x1868797311978880:12345-192.168.202.7@tcp:13: 00002000:00000024:3.0:1782224148.802639:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224148.802727:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:5644:x1868797311978880:12345-192.168.202.7@tcp:13: Request processed in 142us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224148.802734:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00080000:2.0:1782224148.803050:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782224149.204675:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224149.589528:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332972288:0@lo:400: 00000100:00100000:3.0:1782224149.589612:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224149.589667:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782224149.589679:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332972416:0@lo:400: 00000100:00100000:3.0:1782224149.589705:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224149.589779:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797332972160:0@lo:400: 00000100:00100000:2.0:1782224149.589814:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224149.589843:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332972672:0@lo:400: 00000100:00100000:2.0:1782224149.589874:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224149.589896:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782224149.589902:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332972032:0@lo:400: 00000100:00100000:2.0:1782224149.589929:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224149.589949:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332972544:0@lo:400: 00000100:00100000:2.0:1782224149.589971:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224149.590005:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332972416 00000100:00100000:2.0:1782224149.590012:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332972416 00000100:00100000:2.0:1782224149.590080:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332972672 00000100:00100000:2.0:1782224149.590084:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332972672 00000100:00100000:2.0:1782224149.590117:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782224149.590125:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332972416:12345-0@lo:400: 00000100:00100000:2.0:1782224149.590178:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332972416:12345-0@lo:400: Request processed in 53us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224149.590186:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782224149.590203:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782224149.590208:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332972672:12345-0@lo:400: 00000100:00100000:2.0:1782224149.590240:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332972672:12345-0@lo:400: Request processed in 31us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224149.590246:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782224149.590263:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332972032 00000100:00100000:2.0:1782224149.590267:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332972032 00000100:00100000:2.0:1782224149.590290:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1782224149.590297:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea90c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797332972032:12345-0@lo:400: 00000100:00100000:2.0:1782224149.590336:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea90c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797332972032:12345-0@lo:400: Request processed in 40us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224149.590343:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1782224149.590372:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332972288 00000100:00100000:2.0:1782224149.590376:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332972288 00000100:00100000:2.0:1782224149.590398:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332972160 00000100:00100000:2.0:1782224149.590400:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332972160 00000100:00100000:2.0:1782224149.590410:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332972544 00000100:00100000:2.0:1782224149.590412:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332972544 00000100:00100000:2.0:1782224149.590424:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782224149.590429:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332972288:12345-0@lo:400: 00000100:00100000:2.0:1782224149.590459:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332972288:12345-0@lo:400: Request processed in 29us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224149.590466:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782224149.590477:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782224149.590483:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797332972160:12345-0@lo:400: 00000100:00100000:2.0:1782224149.590507:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797332972160:12345-0@lo:400: Request processed in 24us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224149.590513:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782224149.590523:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782224149.590529:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332972544:12345-0@lo:400: 00000100:00100000:2.0:1782224149.590552:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332972544:12345-0@lo:400: Request processed in 25us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224149.590557:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1782224149.590578:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782224149.590582:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782224149.590606:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332972032:0@lo:400: 00000100:00100000:2.0:1782224149.590630:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332972544:0@lo:400: 00000100:00100000:2.0:1782224149.590641:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797332972160:0@lo:400: 00010000:00080000:2.0:1782224149.590652:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabfa93480 x1868797332972672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224149.590663:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332972672:0@lo:400: 00010000:00080000:3.0:1782224149.592077:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabfa93b80 x1868797332972416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224149.592091:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332972416:0@lo:400: 00000100:00100000:3.0:1782224149.592104:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332972288:0@lo:400: 00000100:00100000:2.0:1782224150.100508:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332972800:0@lo:13: 00000100:00100000:2.0:1782224150.100585:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224150.100768:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332972800 00000100:00100000:1.0:1782224150.100777:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332972800 00000100:00100000:1.0:1782224150.100852:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782224150.100863:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332972800:12345-0@lo:13: 00002000:00000024:1.0:1782224150.100889:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224150.100951:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332972800:12345-0@lo:13: Request processed in 90us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224150.100959:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1782224150.101000:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea88af7480 x1868797332972800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224150.101034:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332972800:0@lo:13: 00000001:00100000:2.0:1782224150.206047:0:6608:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 00000001:00100000:2.0:1782224150.207716:0:5808:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 00010000:00010000:2.0:1782224150.230564:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224151.081072:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224151.081110:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224151.081153:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224151.081178:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224151.081211:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311979392 00000100:00100000:3.0:1782224151.081221:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311979392 00000100:00100000:3.0:1782224151.081458:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311979264 00000100:00100000:3.0:1782224151.081463:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311979264 00000100:00100000:3.0:1782224151.081502:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:3.0:1782224151.081514:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2349:x1868797311979392:12345-192.168.202.7@tcp:400: 00000100:00100000:3.0:1782224151.081599:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2349:x1868797311979392:12345-192.168.202.7@tcp:400: Request processed in 87us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224151.081606:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:3.0:1782224151.081624:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:3.0:1782224151.081632:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2348:x1868797311979264:12345-192.168.202.7@tcp:400: 00000100:00100000:3.0:1782224151.081666:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2348:x1868797311979264:12345-192.168.202.7@tcp:400: Request processed in 26us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224151.081673:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00080000:3.0:1782224151.081701:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782224151.081705:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782224151.082955:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311979136 00000100:00100000:1.0:1782224151.082972:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311979136 00000100:00100000:1.0:1782224151.083073:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 25 00000100:00100000:1.0:1782224151.083084:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2349:x1868797311979136:12345-192.168.202.7@tcp:400: 00000100:00100000:1.0:1782224151.083150:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2349:x1868797311979136:12345-192.168.202.7@tcp:400: Request processed in 69us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224151.083169:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 25 00000100:00100000:0.0:1782224151.084058:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311979008 00000100:00100000:0.0:1782224151.084066:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311979008 00000100:00100000:0.0:1782224151.084110:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 130 00000100:00100000:0.0:1782224151.084120:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea90c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2348:x1868797311979008:12345-192.168.202.7@tcp:400: 00000100:00100000:0.0:1782224151.084165:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea90c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2348:x1868797311979008:12345-192.168.202.7@tcp:400: Request processed in 47us (3159us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224151.084172:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 130 00000100:00080000:3.0:1782224151.089943:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1782224151.247729:0:7486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 00010000:00010000:1.0:1782224151.266741:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782224151.586843:0:8138:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1782224152.276193:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224153.308159:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224153.685052:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224153.687479:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332972928:0@lo:13: 00000100:00100000:2.0:1782224153.687563:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224153.689703:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332972928 00000100:00100000:1.0:1782224153.689717:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332972928 00000100:00100000:2.0:1782224153.690201:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1782224153.690249:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782224153.690366:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332972928:12345-0@lo:13: 00002000:00000024:2.0:1782224153.690476:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224153.690618:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332972928:12345-0@lo:13: Request processed in 407us (3054us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224153.690626:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1782224153.690693:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc88ea00 x1868797332972928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224153.690717:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332972928:0@lo:13: 00010000:00010000:3.0:1782224154.325659:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224154.710784:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332973312:0@lo:400: 00000100:00100000:0.0:1782224154.710871:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224154.710961:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782224154.710968:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332973440:0@lo:400: 00000100:00100000:0.0:1782224154.710998:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224154.711072:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332973312 00000100:00100000:0.0:1782224154.711082:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332973312 00000100:00100000:0.0:1782224154.711150:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782224154.711160:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332973312:12345-0@lo:400: 00000100:00100000:0.0:1782224154.711223:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332973312:12345-0@lo:400: Request processed in 65us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224154.711231:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782224154.711257:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332973440 00000100:00100000:0.0:1782224154.711261:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332973440 00000100:00100000:0.0:1782224154.711301:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782224154.711308:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332973440:12345-0@lo:400: 00000100:00100000:0.0:1782224154.711339:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332973440:12345-0@lo:400: Request processed in 32us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224154.711345:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1782224154.711362:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782224154.711401:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea88af6d80 x1868797332973440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224154.711415:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332973440:0@lo:400: 00000100:00100000:0.0:1782224154.711427:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332973312:0@lo:400: 00000100:00100000:2.0:1782224154.711636:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797332973184:0@lo:400: 00000100:00100000:2.0:1782224154.711668:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224154.711696:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332973696:0@lo:400: 00000100:00100000:2.0:1782224154.711725:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224154.711748:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782224154.711754:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332973056:0@lo:400: 00000100:00100000:2.0:1782224154.711794:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224154.711818:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332973568:0@lo:400: 00000100:00100000:2.0:1782224154.711856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224154.711977:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332973184 00000100:00100000:1.0:1782224154.711982:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332973184 00000100:00100000:1.0:1782224154.712039:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332973568 00000100:00100000:1.0:1782224154.712042:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332973568 00000100:00100000:1.0:1782224154.712067:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782224154.712074:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797332973184:12345-0@lo:400: 00000100:00100000:1.0:1782224154.712117:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797332973184:12345-0@lo:400: Request processed in 43us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224154.712123:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782224154.712130:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332973696 00000100:00100000:3.0:1782224154.712137:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332973696 00000100:00100000:1.0:1782224154.712139:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782224154.712149:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332973568:12345-0@lo:400: 00000100:00100000:1.0:1782224154.712176:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332973568:12345-0@lo:400: Request processed in 29us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224154.712181:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782224154.712186:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782224154.712194:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332973696:12345-0@lo:400: 00000100:00100000:3.0:1782224154.712240:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332973696:12345-0@lo:400: Request processed in 49us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224154.712248:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782224154.712271:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332973056 00000100:00100000:3.0:1782224154.712275:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332973056 00000100:00100000:3.0:1782224154.712311:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1782224154.712318:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea90c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797332973056:12345-0@lo:400: 00000100:00100000:3.0:1782224154.712350:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea90c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797332973056:12345-0@lo:400: Request processed in 32us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224154.712356:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1782224154.712735:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332973056:0@lo:400: 00000100:00100000:2.0:1782224154.712750:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332973568:0@lo:400: 00000100:00100000:2.0:1782224154.712760:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797332973184:0@lo:400: 00010000:00080000:2.0:1782224154.712770:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea88af5f80 x1868797332973696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224154.712789:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332973696:0@lo:400: 00000100:00080000:0.0:1782224154.713111:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782224154.713115:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782224155.221879:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332973824:0@lo:13: 00000100:00100000:0.0:1782224155.221975:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224155.222085:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332973824 00000100:00100000:0.0:1782224155.222102:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332973824 00000100:00100000:0.0:1782224155.222157:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782224155.222167:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332973824:12345-0@lo:13: 00002000:00000024:0.0:1782224155.222211:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782224155.222266:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332973824:12345-0@lo:13: Request processed in 99us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224155.222274:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1782224155.222319:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea88af4a80 x1868797332973824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224155.222340:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332973824:0@lo:13: 00000020:00000080:3.0:1782224155.323683:0:8286:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe54a7ae30 20000000:00000080:3.0:1782224155.323701:0:8286:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96e984d32c00 uarg=0000000000000000 20000000:01000000:3.0:1782224155.323737:0:8286:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1782224155.323739:0:8286:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1782224155.323741:0:8286:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1782224155.323746:0:8286:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1782224155.323752:0:8286:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1782224155.323764:0:8286:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782224155.323766:0:8286:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1782224155.324087:0:8286:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782224155.324091:0:8286:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1782224155.325672:0:8287:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1782224155.326142:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1782224155.326183:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1782224155.326212:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1782224155.326222:0:8286:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1782224155.326341:0:8286:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782224155.327914:0:8288:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1782224155.328696:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1782224155.328753:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1782224155.328793:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1782224155.328803:0:8286:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782224155.328805:0:8286:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782224155.329966:0:8289:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1782224155.334274:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1782224155.334336:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1782224155.334366:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1782224155.334605:0:8286:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782224155.334609:0:8286:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782224155.335798:0:8290:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1782224155.339283:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1782224155.339415:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1782224155.339542:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1782224155.339575:0:8286:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782224155.339601:0:8286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96eabbb86e00/0xcfd8b3ae4b1648d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.339623:0:8286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1647cf expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.339643:0:8286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96eabb611800/0xcfd8b3ae4b164800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1647f9 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.339650:0:8286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b16482a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164823 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.339674:0:8286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96eabbb87800/0xcfd8b3ae4b164838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164831 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.339682:0:8286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b164846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16483f expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.339690:0:8286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96eabbb86c00/0xcfd8b3ae4b164862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16485b expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.339698:0:8286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b16488c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164885 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.339708:0:8286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b16489a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51442 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.339716:0:8286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea90674200/0xcfd8b3ae4b1648a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51449 expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.339725:0:8286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96eabbb86e00/0xcfd8b3ae4b1648d9 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.339789:0:8286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea90674200/0xcfd8b3ae4b1648a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51449 expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.339808:0:8286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96ea90674200/0xcfd8b3ae4b1648a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51449 expref: 9 pid: 5780 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224155.339825:0:8286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1868797332973952:192.168.202.7@tcp:104: 00010000:00010000:0.0:1782224155.340730:0:8286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b16489a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51442 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.340752:0:8286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b16489a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51442 expref: 9 pid: 5779 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224155.340764:0:8286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1868797332974080:192.168.202.7@tcp:104: 00010000:00010000:0.0:1782224155.340813:0:8286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b16488c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b164885 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.340821:0:8286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b16488c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164885 expref: 18 pid: 5779 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224155.340842:0:8286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1868797332974208:0@lo:104: 00000100:00100000:0.0:1782224155.340892:0:8286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782224155.340954:0:8286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96eabbb86c00/0xcfd8b3ae4b164862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b16485b expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.340963:0:8286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96eabbb86c00/0xcfd8b3ae4b164862 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16485b expref: 18 pid: 5781 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224155.340972:0:8286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1868797332974336:0@lo:104: 00000100:00100000:0.0:1782224155.340997:0:8286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782224155.341046:0:8286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b164846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b16483f expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.341054:0:8286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b164846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16483f expref: 18 pid: 5781 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224155.341063:0:8286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1868797332974464:0@lo:104: 00010000:00010000:0.0:1782224155.341087:0:8286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96eabbb87800/0xcfd8b3ae4b164838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b164831 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.341102:0:8286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96eabbb87800/0xcfd8b3ae4b164838 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164831 expref: 18 pid: 5780 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224155.341110:0:8286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1868797332974592:0@lo:104: 00010000:00010000:0.0:1782224155.341138:0:8286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b16482a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b164823 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.341146:0:8286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b16482a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164823 expref: 18 pid: 5780 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224155.341153:0:8286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1868797332974720:0@lo:104: 00010000:00010000:0.0:1782224155.341173:0:8286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96eabb611800/0xcfd8b3ae4b164800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b1647f9 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.341180:0:8286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96eabb611800/0xcfd8b3ae4b164800 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1647f9 expref: 18 pid: 5779 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224155.341186:0:8286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1868797332974848:0@lo:104: 00010000:00010000:0.0:1782224155.341203:0:8286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b1647cf expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224155.341210:0:8286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1647cf expref: 18 pid: 5779 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224155.341218:0:8286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1868797332974976:0@lo:104: 00000100:00100000:0.0:1782224155.341235:0:8286:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07780 going to sleep for 11 seconds 00000100:00100000:1.0:1782224155.342502:0:5768:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782224155.342543:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224155.342571:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224155.342580:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224155.342608:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224155.342620:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224155.342632:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332974208 00000100:00100000:1.0:1782224155.342640:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332974208 00000100:00100000:1.0:1782224155.342690:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332974336 00000100:00100000:1.0:1782224155.342693:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332974336 00000100:00100000:1.0:1782224155.342702:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332974464 00000100:00100000:1.0:1782224155.342705:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332974464 00000100:00100000:1.0:1782224155.342714:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332974592 00000100:00100000:1.0:1782224155.342716:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332974592 00000100:00100000:1.0:1782224155.342724:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332974720 00000100:00100000:1.0:1782224155.342726:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332974720 00000100:00100000:1.0:1782224155.342734:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332974848 00000100:00100000:1.0:1782224155.342736:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332974848 00000100:00100000:1.0:1782224155.342745:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332974976 00000100:00100000:1.0:1782224155.342747:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332974976 00000100:00100000:1.0:1782224155.342761:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782224155.342783:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+9:8286:x1868797332974208:12345-0@lo:104: 00010000:00010000:1.0:1782224155.342804:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b16488c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.342899:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782224155.342906:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+9:8286:x1868797332974208:12345-0@lo:104: Request processed in 137us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224155.342930:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782224155.342952:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782224155.342959:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf723850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+8:8286:x1868797332974336:12345-0@lo:104: 00010000:00010000:1.0:1782224155.342967:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b16485b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343033:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782224155.343039:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf723850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+8:8286:x1868797332974336:12345-0@lo:104: Request processed in 82us (2042us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224155.343045:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782224155.343079:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782224155.343086:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+7:8286:x1868797332974464:12345-0@lo:104: 00010000:00010000:1.0:1782224155.343094:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eabbb86000/0xcfd8b3ae4b16483f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164846 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343121:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782224155.343126:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+7:8286:x1868797332974464:12345-0@lo:104: Request processed in 42us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224155.343132:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782224155.343142:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782224155.343148:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+6:8286:x1868797332974592:12345-0@lo:104: 00010000:00010000:1.0:1782224155.343155:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96ea90674a00/0xcfd8b3ae4b164831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164838 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343178:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1782224155.343182:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+6:8286:x1868797332974592:12345-0@lo:104: Request processed in 36us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224155.343194:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782224155.343205:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782224155.343211:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+5:8286:x1868797332974720:12345-0@lo:104: 00010000:00010000:1.0:1782224155.343219:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b164823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b16482a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343245:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1782224155.343249:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+5:8286:x1868797332974720:12345-0@lo:104: Request processed in 39us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224155.343255:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782224155.343264:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782224155.343269:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+4:8286:x1868797332974848:12345-0@lo:104: 00010000:00010000:1.0:1782224155.343276:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b1647f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164800 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343299:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1782224155.343303:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+4:8286:x1868797332974848:12345-0@lo:104: Request processed in 35us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224155.343309:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782224155.343319:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782224155.343324:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+3:8286:x1868797332974976:12345-0@lo:104: 00010000:00010000:1.0:1782224155.343332:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eabbb86200/0xcfd8b3ae4b1647cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1647d6 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343354:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1782224155.343359:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+3:8286:x1868797332974976:12345-0@lo:104: Request processed in 35us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224155.343370:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1782224155.343391:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1782224155.343398:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b16488c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343407:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675e00 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:1.0:1782224155.343412:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b16488c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343423:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b16488c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224155.343432:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b16488c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224155.343439:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782224155.343479:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16488c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343486:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782224155.343512:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164885 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16488c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343520:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164885 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16488c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343545:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1782224155.343548:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b16485b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343571:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674600 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:1.0:1782224155.343574:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b16485b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b164862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343580:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b16485b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b164862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224155.343586:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b16485b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b164862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224155.343591:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782224155.343605:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b16485b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343611:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782224155.343635:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b16485b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343642:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b16485b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164862 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343656:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1782224155.343659:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabbb86000/0xcfd8b3ae4b16483f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164846 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343665:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86000 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:1.0:1782224155.343668:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabbb86000/0xcfd8b3ae4b16483f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b164846 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343685:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabbb86000/0xcfd8b3ae4b16483f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b164846 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224155.343691:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabbb86000/0xcfd8b3ae4b16483f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b164846 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224155.343696:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782224155.343710:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabbb86000/0xcfd8b3ae4b16483f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164846 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343716:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782224155.343722:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabbb86000/0xcfd8b3ae4b16483f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164846 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343729:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabbb86000/0xcfd8b3ae4b16483f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164846 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343737:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1782224155.343740:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea90674a00/0xcfd8b3ae4b164831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164838 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343746:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674a00 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:1.0:1782224155.343748:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea90674a00/0xcfd8b3ae4b164831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b164838 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343755:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea90674a00/0xcfd8b3ae4b164831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b164838 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224155.343760:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea90674a00/0xcfd8b3ae4b164831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b164838 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224155.343782:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782224155.343797:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96ea90674a00/0xcfd8b3ae4b164831 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164838 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343803:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782224155.343808:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea90674a00/0xcfd8b3ae4b164831 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164838 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343816:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea90674a00/0xcfd8b3ae4b164831 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164838 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343826:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782224155.343829:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b164823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b16482a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343836:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87400 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:1.0:1782224155.343839:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b164823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b16482a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343846:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b164823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b16482a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224155.343852:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b164823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b16482a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224155.343857:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782224155.343868:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b164823 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16482a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343874:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782224155.343883:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b164823 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16482a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343890:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b164823 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b16482a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343899:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782224155.343902:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b1647f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164800 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343908:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabb611e00 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:1.0:1782224155.343911:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b1647f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b164800 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343918:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b1647f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b164800 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224155.343924:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b1647f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b164800 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224155.343930:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782224155.343942:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b1647f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164800 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343948:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782224155.343951:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b1647f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164800 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343958:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b1647f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164800 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343966:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224155.343975:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabbb86200/0xcfd8b3ae4b1647cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1647d6 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343980:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86200 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:1.0:1782224155.343983:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabbb86200/0xcfd8b3ae4b1647cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b1647d6 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.343989:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabbb86200/0xcfd8b3ae4b1647cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b1647d6 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224155.343995:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabbb86200/0xcfd8b3ae4b1647cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b1647d6 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224155.344000:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782224155.344037:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabbb86200/0xcfd8b3ae4b1647cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1647d6 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.344043:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782224155.344047:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabbb86200/0xcfd8b3ae4b1647cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1647d6 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.344052:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabbb86200/0xcfd8b3ae4b1647cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1647d6 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.344066:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224155.344067:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224155.344069:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224155.344086:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797332975104:0@lo:103: 00000100:00100000:1.0:1782224155.344135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224155.344163:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797332975616:0@lo:103: 00000100:00100000:1.0:1782224155.344195:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224155.344218:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782224155.344224:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797332975488:0@lo:103: 00000100:00100000:1.0:1782224155.344245:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224155.344275:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332975232:0@lo:103: 00000100:00100000:1.0:1782224155.344296:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224155.344306:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332975744:0@lo:103: 00000100:00100000:1.0:1782224155.344322:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224155.344333:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782224155.344338:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332975360:0@lo:103: 00000100:00100000:1.0:1782224155.344355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224155.344363:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332975872:0@lo:103: 00000100:00100000:1.0:1782224155.344381:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224155.344402:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332975104 00000100:00100000:1.0:1782224155.344409:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332975104 00010000:00010000:1.0:1782224155.344435:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b16488c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164885 expref: 19 pid: 5779 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224155.344454:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332975616 00000100:00100000:1.0:1782224155.344456:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332975616 00010000:00010000:1.0:1782224155.344468:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b16482a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164823 expref: 20 pid: 5780 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224155.344478:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332975488 00000100:00100000:1.0:1782224155.344480:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332975488 00010000:00010000:1.0:1782224155.344489:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96eabbb87800/0xcfd8b3ae4b164838 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164831 expref: 21 pid: 5780 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224155.344498:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332975232 00000100:00100000:1.0:1782224155.344507:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332975232 00010000:00010000:1.0:1782224155.344519:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96eabbb86c00/0xcfd8b3ae4b164862 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16485b expref: 22 pid: 5781 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224155.344529:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332975744 00000100:00100000:1.0:1782224155.344532:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332975744 00010000:00010000:1.0:1782224155.344541:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96eabb611800/0xcfd8b3ae4b164800 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1647f9 expref: 23 pid: 5779 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224155.344551:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332975360 00000100:00100000:1.0:1782224155.344553:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332975360 00010000:00010000:1.0:1782224155.344562:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b164846 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16483f expref: 24 pid: 5781 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224155.344570:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332975872 00000100:00100000:1.0:1782224155.344572:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332975872 00010000:00010000:1.0:1782224155.344580:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1647cf expref: 25 pid: 5779 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224155.344591:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782224155.344599:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+25:3304:x1868797332975104:12345-0@lo:103: 00010000:00010000:1.0:1782224155.344613:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224155.344618:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b16488c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164885 expref: 25 pid: 5779 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.344628:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b16488c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164885 expref: 25 pid: 5779 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.344647:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224155.344678:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+25:3304:x1868797332975104:12345-0@lo:103: Request processed in 79us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224155.344685:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782224155.344708:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782224155.344714:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+24:3304:x1868797332975616:12345-0@lo:103: 00010000:00010000:1.0:1782224155.344721:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224155.344726:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b16482a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164823 expref: 24 pid: 5780 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.344734:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b16482a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164823 expref: 24 pid: 5780 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.344743:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224155.344796:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+24:3304:x1868797332975616:12345-0@lo:103: Request processed in 53us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224155.344802:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782224155.344813:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782224155.344819:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+23:3304:x1868797332975488:12345-0@lo:103: 00010000:00010000:1.0:1782224155.344825:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224155.344830:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96eabbb87800/0xcfd8b3ae4b164838 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164831 expref: 23 pid: 5780 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.344838:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96eabbb87800/0xcfd8b3ae4b164838 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164831 expref: 23 pid: 5780 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.344846:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224155.344865:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+23:3304:x1868797332975488:12345-0@lo:103: Request processed in 46us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224155.344870:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782224155.344885:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782224155.344891:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+22:3305:x1868797332975232:12345-0@lo:103: 00010000:00010000:1.0:1782224155.344899:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224155.344908:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96eabbb86c00/0xcfd8b3ae4b164862 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16485b expref: 22 pid: 5781 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.344916:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96eabbb86c00/0xcfd8b3ae4b164862 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16485b expref: 22 pid: 5781 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.344925:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224155.344951:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+22:3305:x1868797332975232:12345-0@lo:103: Request processed in 60us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224155.344956:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782224155.344968:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782224155.344974:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+21:3305:x1868797332975744:12345-0@lo:103: 00010000:00010000:1.0:1782224155.344981:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224155.344985:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96eabb611800/0xcfd8b3ae4b164800 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1647f9 expref: 21 pid: 5779 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.344992:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96eabb611800/0xcfd8b3ae4b164800 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1647f9 expref: 21 pid: 5779 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.345000:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224155.345040:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+21:3305:x1868797332975744:12345-0@lo:103: Request processed in 66us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224155.345046:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782224155.345057:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782224155.345064:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+20:3305:x1868797332975360:12345-0@lo:103: 00010000:00010000:1.0:1782224155.345071:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224155.345075:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b164846 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16483f expref: 20 pid: 5781 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.345093:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b164846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16483f expref: 20 pid: 5781 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.345102:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224155.345123:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+20:3305:x1868797332975360:12345-0@lo:103: Request processed in 60us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224155.345129:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782224155.345141:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782224155.345147:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea860b1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332975872:12345-0@lo:103: 00010000:00010000:1.0:1782224155.345153:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224155.345157:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1647cf expref: 19 pid: 5779 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.345164:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1647cf expref: 19 pid: 5779 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.345173:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224155.345189:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea860b1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332975872:12345-0@lo:103: Request processed in 44us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224155.345194:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782224155.345254:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332975360:0@lo:103: 00000100:00100000:1.0:1782224155.345264:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332975872:0@lo:103: 00000100:00100000:1.0:1782224155.345270:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332975232:0@lo:103: 00000100:00100000:1.0:1782224155.345277:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332975744:0@lo:103: 00000100:00100000:1.0:1782224155.345307:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797332975488:0@lo:103: 00000100:00100000:1.0:1782224155.345322:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797332975104:0@lo:103: 00000100:00100000:1.0:1782224155.345328:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797332975616:0@lo:103: 00010000:00010000:0.0:1782224155.345555:0:8286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b16488c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b164885 expref: 18 pid: 5779 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224155.345582:0:8286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1868797332974208:0@lo:104: 00010000:00010000:0.0:1782224155.345595:0:8286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabbb86c00/0xcfd8b3ae4b164862 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b16485b expref: 17 pid: 5781 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224155.345603:0:8286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1868797332974336:0@lo:104: 00010000:00010000:0.0:1782224155.345612:0:8286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b164846 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b16483f expref: 16 pid: 5781 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224155.345622:0:8286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1868797332974464:0@lo:104: 00010000:00010000:0.0:1782224155.345631:0:8286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabbb87800/0xcfd8b3ae4b164838 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b164831 expref: 15 pid: 5780 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224155.345638:0:8286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1868797332974592:0@lo:104: 00010000:00010000:0.0:1782224155.345648:0:8286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b16482a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b164823 expref: 14 pid: 5780 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224155.345655:0:8286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1868797332974720:0@lo:104: 00010000:00010000:0.0:1782224155.345664:0:8286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabb611800/0xcfd8b3ae4b164800 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b1647f9 expref: 13 pid: 5779 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224155.345673:0:8286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1868797332974848:0@lo:104: 00010000:00010000:0.0:1782224155.345682:0:8286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1647d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b1647cf expref: 12 pid: 5779 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224155.345691:0:8286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1868797332974976:0@lo:104: 00010000:00010000:0.0:1782224155.346923:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224155.348591:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224155.351760:0:8286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1868797332973952:192.168.202.7@tcp:104: 00000100:00100000:0.0:1782224155.351796:0:8286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1868797332974080:192.168.202.7@tcp:104: 00010000:00010000:0.0:1782224155.351957:0:8286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96eabbb86e00/0xcfd8b3ae4b1648d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224155.353858:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224155.353960:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224155.354445:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311979520 00000100:00100000:1.0:1782224155.354458:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311979520 00010000:00010000:1.0:1782224155.354507:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea90674200/0xcfd8b3ae4b1648a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51449 expref: 10 pid: 5780 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224155.354549:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311979648 00000100:00100000:1.0:1782224155.354551:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311979648 00010000:00010000:1.0:1782224155.354564:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b16489a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51442 expref: 11 pid: 5779 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224155.354580:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:1.0:1782224155.354591:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4fff53da-03fa-4566-9f6c-b379e18824a7+11:2346:x1868797311979520:12345-192.168.202.7@tcp:103: 00010000:00010000:1.0:1782224155.354612:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782224155.354613:0:5772:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1782224155.354627:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1782224155.354634:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea90674200/0xcfd8b3ae4b1648a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51449 expref: 11 pid: 5780 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.354651:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea90674200/0xcfd8b3ae4b1648a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51449 expref: 11 pid: 5780 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.354678:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90674200/0xcfd8b3ae4b1648a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51449 expref: 11 pid: 5780 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.354695:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224155.354783:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2346:x1868797311979520:12345-192.168.202.7@tcp:103: Request processed in 193us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224155.354812:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:1.0:1782224155.354848:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:1.0:1782224155.354857:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4fff53da-03fa-4566-9f6c-b379e18824a7+9:2346:x1868797311979648:12345-192.168.202.7@tcp:103: 00010000:00010000:1.0:1782224155.354865:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224155.354870:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b16489a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51442 expref: 9 pid: 5779 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.354881:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b16489a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51442 expref: 9 pid: 5779 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.354892:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b16489a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51442 expref: 9 pid: 5779 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.354904:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96eabbb86e00/0xcfd8b3ae4b1648d9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.354914:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbb86e00/0xcfd8b3ae4b1648d9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.354933:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96eabbb86e00/0xcfd8b3ae4b1648d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.354941:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96eabbb86e00/0xcfd8b3ae4b1648d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.354948:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96eabbb86e00/0xcfd8b3ae4b1648d9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.354956:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96eabbb86e00/0xcfd8b3ae4b1648d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.354969:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86e00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224155.354974:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96eabbb86e00/0xcfd8b3ae4b1648d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.354984:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96eabbb86e00/0xcfd8b3ae4b1648d9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.355009:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96eabbb86e00/0xcfd8b3ae4b1648d9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224155.355174:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782224155.355187:0:8286:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96eabbb86e00/0xcfd8b3ae4b1648d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224155.355199:0:8286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96eabbb86e00/0xcfd8b3ae4b1648d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224155.355208:0:8286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabbb86e00/0xcfd8b3ae4b1648d9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224155.355219:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4fff53da-03fa-4566-9f6c-b379e18824a7+8:2346:x1868797311979648:12345-192.168.202.7@tcp:103: Request processed in 362us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224155.355228:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:3.0:1782224156.180847:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224156.180902:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224156.180935:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224156.180961:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224156.181072:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311979904 00000100:00100000:1.0:1782224156.181087:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311979904 00000100:00100000:1.0:1782224156.181192:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 29 00000100:00100000:0.0:1782224156.181201:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311980160 00000100:00100000:1.0:1782224156.181211:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2349:x1868797311979904:12345-192.168.202.7@tcp:400: 00000100:00100000:0.0:1782224156.181215:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311980160 00000100:00100000:0.0:1782224156.181277:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311980032 00000100:00100000:0.0:1782224156.181282:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311980032 00000100:00100000:1.0:1782224156.181321:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2349:x1868797311979904:12345-192.168.202.7@tcp:400: Request processed in 117us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224156.181331:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:1.0:1782224156.181340:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 29 00000100:00100000:0.0:1782224156.181349:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2349:x1868797311980160:12345-192.168.202.7@tcp:400: 00000100:00100000:1.0:1782224156.181407:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:1.0:1782224156.181420:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2348:x1868797311980032:12345-192.168.202.7@tcp:400: 00000100:00100000:0.0:1782224156.181430:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2349:x1868797311980160:12345-192.168.202.7@tcp:400: Request processed in 83us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224156.181441:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:1.0:1782224156.181466:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2348:x1868797311980032:12345-192.168.202.7@tcp:400: Request processed in 47us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224156.181477:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00080000:3.0:1782224156.182236:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782224156.182242:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782224156.182246:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224156.186191:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311979776 00000100:00100000:2.0:1782224156.186215:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311979776 00000100:00100000:2.0:1782224156.186314:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 132 00000100:00100000:2.0:1782224156.186327:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+8:2348:x1868797311979776:12345-192.168.202.7@tcp:400: 00000100:00100000:2.0:1782224156.186463:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+8:2348:x1868797311979776:12345-192.168.202.7@tcp:400: Request processed in 139us (5561us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224156.186472:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 132 00010000:00010000:0.0:1782224156.372641:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782224156.820615:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782224156.820626:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff96eabfbe5800 from 39 10000000:01000000:0.0:1782224156.820633:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782224156.820699:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb86c00/0xcfd8b3ae4b1648e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224156.820714:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabbb86c00/0xcfd8b3ae4b1648e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224156.820730:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabbb86c00/0xcfd8b3ae4b1648e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224156.820778:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332976000:0@lo:101: 00000100:00100000:0.0:1782224156.820896:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224156.820984:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07480 going to sleep for 11 seconds 00000100:00100000:3.0:1782224156.821128:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332976000 00000100:00100000:3.0:1782224156.821140:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332976000 00000100:00100000:3.0:1782224156.821208:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1782224156.821220:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+12:5783:x1868797332976000:12345-0@lo:101: 00010000:00010000:3.0:1782224156.821238:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224156.821256:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b1648e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1648e0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224156.821285:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b1648e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1648e0 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224156.821304:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b1648e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1648e0 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224156.821315:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674000, rc 0) 00000100:00100000:3.0:1782224156.821375:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+13:5783:x1868797332976000:12345-0@lo:101: Request processed in 156us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224156.821394:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1782224156.821437:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332976000:0@lo:101: 00010000:00010000:1.0:1782224156.821456:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabbb86c00/0xcfd8b3ae4b1648e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1648e7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224156.821466:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabbb86c00/0xcfd8b3ae4b1648e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b1648e7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224156.821544:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332976128:0@lo:501: 00000100:00100000:1.0:1782224156.821577:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224156.821611:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaaa254540 going to sleep for 11 seconds 00000100:00100000:2.0:1782224156.821668:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332976128 00000100:00100000:2.0:1782224156.821673:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332976128 00000100:00100000:2.0:1782224156.821710:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782224156.821717:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:5783:x1868797332976128:12345-0@lo:501: 00000100:00100000:2.0:1782224156.822087:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:5783:x1868797332976128:12345-0@lo:501: Request processed in 369us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224156.822103:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1782224156.822183:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332976128:0@lo:501: 00000100:00100000:1.0:1782224156.822219:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332976256:0@lo:503: 00000100:00100000:1.0:1782224156.822261:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224156.822278:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaaa254540 going to sleep for 11 seconds 00000100:00100000:0.0:1782224156.822490:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332976256 00000100:00100000:0.0:1782224156.822495:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332976256 00000100:00100000:0.0:1782224156.822532:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1782224156.822540:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+13:5783:x1868797332976256:12345-0@lo:503: 00000100:00100000:0.0:1782224156.822726:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+13:5783:x1868797332976256:12345-0@lo:503: Request processed in 187us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224156.822741:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332976256:0@lo:503: 00000100:00100000:0.0:1782224156.822747:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1782224156.823170:0:8304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f53b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8304:1868797332976384:0@lo:502: 00000100:00100000:1.0:1782224156.823209:0:8304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224156.823854:0:8304:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaaa254d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782224156.823897:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332976384 00000100:00100000:0.0:1782224156.823903:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332976384 00000100:00100000:0.0:1782224156.823984:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1782224156.823993:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+13:8304:x1868797332976384:12345-0@lo:502: 00000100:00100000:0.0:1782224156.824261:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+13:8304:x1868797332976384:12345-0@lo:502: Request processed in 269us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224156.824268:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1782224156.824368:0:8304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f53b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8304:1868797332976384:0@lo:502: 00000100:00100000:1.0:1782224156.824419:0:8304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f53b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8304:1868797332976512:0@lo:502: 00000100:00100000:1.0:1782224156.824477:0:8304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224156.825272:0:8304:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaaa254d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782224156.825408:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332976512 00000100:00100000:2.0:1782224156.825418:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332976512 00000100:00100000:2.0:1782224156.826284:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1782224156.826307:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:8304:x1868797332976512:12345-0@lo:502: 00000100:00100000:2.0:1782224156.826891:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:8304:x1868797332976512:12345-0@lo:502: Request processed in 595us (2411us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224156.826900:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1782224156.827098:0:8304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f53b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8304:1868797332976512:0@lo:502: 00000040:00080000:1.0:1782224156.827147:0:8304:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1782224156.829929:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1782224156.829972:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782224156.829989:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb86c00/0xcfd8b3ae4b1648e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1648e7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.830004:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabbb86c00/0xcfd8b3ae4b1648e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1648e7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224156.830041:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1782224156.830045:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1782224156.830048:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1782224156.830095:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb611200/0xcfd8b3ae4b1648ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.830105:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabb611200/0xcfd8b3ae4b1648ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.830118:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabb611200/0xcfd8b3ae4b1648ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224156.830146:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332976640:0@lo:101: 00000100:00100000:2.0:1782224156.830246:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.830306:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc8b6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782224156.830445:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332976640 00000100:00100000:1.0:1782224156.830467:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332976640 00000100:00100000:1.0:1782224156.830515:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1782224156.830524:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+13:5783:x1868797332976640:12345-0@lo:101: 00010000:00010000:1.0:1782224156.830541:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224156.830555:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea99877400/0xcfd8b3ae4b1648f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1648ee expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224156.830583:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea99877400/0xcfd8b3ae4b1648f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1648ee expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224156.830595:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea99877400/0xcfd8b3ae4b1648f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1648ee expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224156.830606:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99877400, rc 0) 00000100:00100000:1.0:1782224156.830649:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+14:5783:x1868797332976640:12345-0@lo:101: Request processed in 125us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224156.830657:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1782224156.830873:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332976640:0@lo:101: 00010000:00010000:2.0:1782224156.830888:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabb611200/0xcfd8b3ae4b1648ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1648f5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.830899:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabb611200/0xcfd8b3ae4b1648ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b1648f5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224156.830951:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332976768:0@lo:501: 00000100:00100000:2.0:1782224156.830976:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.831002:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc8b6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782224156.831127:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332976768 00000100:00100000:1.0:1782224156.831131:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332976768 00000100:00100000:1.0:1782224156.831149:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1782224156.831154:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+14:5783:x1868797332976768:12345-0@lo:501: 00000100:00100000:1.0:1782224156.831620:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+14:5783:x1868797332976768:12345-0@lo:501: Request processed in 463us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224156.831628:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1782224156.831789:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332976768:0@lo:501: 00000100:00100000:2.0:1782224156.831823:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332976896:0@lo:503: 00000100:00100000:2.0:1782224156.831863:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.832007:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc8b6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782224156.833654:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332976896 00000100:00100000:0.0:1782224156.833672:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332976896 00000100:00100000:0.0:1782224156.834000:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782224156.834037:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+14:5783:x1868797332976896:12345-0@lo:503: 00000100:00100000:0.0:1782224156.834350:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+14:5783:x1868797332976896:12345-0@lo:503: Request processed in 338us (2484us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224156.834358:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1782224156.838375:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332976896:0@lo:503: 00000100:00100000:2.0:1782224156.838766:0:8305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8305:1868797332977024:0@lo:502: 00000100:00100000:2.0:1782224156.838872:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.840725:0:8305:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc8b6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782224156.840949:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332977024 00000100:00100000:3.0:1782224156.840961:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332977024 00000100:00100000:3.0:1782224156.841045:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1782224156.841057:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+14:8305:x1868797332977024:12345-0@lo:502: 00000100:00100000:3.0:1782224156.841507:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+14:8305:x1868797332977024:12345-0@lo:502: Request processed in 451us (2635us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224156.841517:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782224156.841626:0:8305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8305:1868797332977024:0@lo:502: 00000020:01000000:2.0:1782224156.841663:0:8305:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782224156.841674:0:8305:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224156.841677:0:8305:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782224156.841684:0:8305:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782224156.841722:0:8305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8305:1868797332977152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782224156.841780:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.841809:0:8305:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea877d7540 going to sleep for 11 seconds 00000100:00100000:3.0:1782224156.841851:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332977152 00000100:00100000:3.0:1782224156.841855:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332977152 00000100:00100000:3.0:1782224156.841873:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1782224156.841879:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+14:8305:x1868797332977152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224156.842001:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+14:8305:x1868797332977152:12345-0@lo:502:llog_process_th.0 Request processed in 121us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224156.842008:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1782224156.842091:0:8305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8305:1868797332977152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782224156.842107:0:8305:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782224156.842111:0:8305:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224156.842112:0:8305:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782224156.842116:0:8305:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1782224156.842446:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1782224156.842466:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782224156.842479:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb611200/0xcfd8b3ae4b1648ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1648f5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224156.842504:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabb611200/0xcfd8b3ae4b1648ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1648f5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224156.842515:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782224156.842518:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff96ea8341a800 from 39 10000000:01000000:3.0:1782224156.842521:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782224156.842556:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675000/0xcfd8b3ae4b1648fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224156.842566:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea90675000/0xcfd8b3ae4b1648fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224156.842576:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea90675000/0xcfd8b3ae4b1648fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224156.842591:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332977280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782224156.842623:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224156.842651:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90e9f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782224156.842709:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332977280 00000100:00100000:1.0:1782224156.842714:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332977280 00000100:00100000:1.0:1782224156.842761:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1782224156.842770:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+14:5783:x1868797332977280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782224156.842782:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224156.842803:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea99876800/0xcfd8b3ae4b164903 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1648fc expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224156.842828:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea99876800/0xcfd8b3ae4b164903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1648fc expref: 15 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224156.842840:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea99876800/0xcfd8b3ae4b164903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1648fc expref: 15 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224156.842850:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99876800, rc 0) 00000100:00100000:1.0:1782224156.842886:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+15:5783:x1868797332977280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224156.842892:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1782224156.842957:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332977280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782224156.842971:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea90675000/0xcfd8b3ae4b1648fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164903 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.842980:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea90675000/0xcfd8b3ae4b1648fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164903 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224156.843051:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332977408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782224156.843078:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.843092:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea877d7540 going to sleep for 11 seconds 00000100:00100000:1.0:1782224156.843151:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332977408 00000100:00100000:1.0:1782224156.843155:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332977408 00000100:00100000:1.0:1782224156.843170:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1782224156.843175:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83492450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+15:5783:x1868797332977408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782224156.843895:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83492450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+15:5783:x1868797332977408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 714us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224156.843904:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782224156.843969:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332977408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782224156.844004:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332977536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782224156.844075:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.844106:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea877d7540 going to sleep for 11 seconds 00000100:00100000:3.0:1782224156.844152:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332977536 00000100:00100000:3.0:1782224156.844157:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332977536 00000100:00100000:3.0:1782224156.844193:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782224156.844200:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:5783:x1868797332977536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224156.844371:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:5783:x1868797332977536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224156.844378:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782224156.844548:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332977536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782224156.844911:0:8306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8306:1868797332977664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782224156.844946:0:8306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.844968:0:8306:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea877d7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782224156.845543:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332977664 00000100:00100000:1.0:1782224156.845551:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332977664 00000100:00100000:1.0:1782224156.845621:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1782224156.845630:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+15:8306:x1868797332977664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782224156.845873:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+15:8306:x1868797332977664:12345-0@lo:502:llog_process_th.0 Request processed in 244us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224156.845881:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1782224156.845946:0:8306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8306:1868797332977664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782224156.845990:0:8306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8306:1868797332977792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782224156.846043:0:8306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.846723:0:8306:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc8b6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782224156.846836:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332977792 00000100:00100000:3.0:1782224156.846843:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332977792 00000100:00100000:3.0:1782224156.846877:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1782224156.846896:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:8306:x1868797332977792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224156.847126:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:8306:x1868797332977792:12345-0@lo:502:llog_process_th.0 Request processed in 231us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224156.847134:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1782224156.847233:0:8306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8306:1868797332977792:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1782224156.847260:0:8306:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1782224156.847830:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1782224156.847849:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782224156.847862:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675000/0xcfd8b3ae4b1648fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164903 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224156.847875:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea90675000/0xcfd8b3ae4b1648fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164903 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224156.847886:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1782224156.847889:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1782224156.847892:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782224156.847927:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90674c00/0xcfd8b3ae4b16490a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224156.847935:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea90674c00/0xcfd8b3ae4b16490a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224156.847945:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea90674c00/0xcfd8b3ae4b16490a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224156.847965:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332977920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782224156.848008:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224156.848070:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90e9f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224156.848138:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332977920 00000100:00100000:2.0:1782224156.848144:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332977920 00000100:00100000:2.0:1782224156.848171:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1782224156.848178:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+15:5783:x1868797332977920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782224156.848189:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224156.848202:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabb611400/0xcfd8b3ae4b164911 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b16490a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.848227:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabb611400/0xcfd8b3ae4b164911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16490a expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.848238:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabb611400/0xcfd8b3ae4b164911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16490a expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.848248:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabb611400, rc 0) 00000100:00100000:2.0:1782224156.848279:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+16:5783:x1868797332977920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224156.848285:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1782224156.848379:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332977920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782224156.848392:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea90674c00/0xcfd8b3ae4b16490a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164911 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.848413:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea90674c00/0xcfd8b3ae4b16490a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164911 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224156.848460:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332978048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782224156.848483:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.848494:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc8b6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782224156.848503:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332978048 00000100:00100000:2.0:1782224156.848506:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332978048 00000100:00100000:2.0:1782224156.848520:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1782224156.848525:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+16:5783:x1868797332978048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782224156.848772:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+16:5783:x1868797332978048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224156.848778:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1782224156.848803:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332978048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782224156.848826:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332978176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782224156.848858:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.848869:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea82eca9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224156.848878:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332978176 00000100:00100000:2.0:1782224156.848880:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332978176 00000100:00100000:2.0:1782224156.848894:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1782224156.848899:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+16:5783:x1868797332978176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782224156.849042:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+16:5783:x1868797332978176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224156.849049:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1782224156.849081:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332978176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782224156.849251:0:8307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8307:1868797332978304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782224156.849280:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.849296:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332978304 00000100:00100000:3.0:1782224156.849434:0:8307:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea882c89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224156.850253:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332978304 00000100:00100000:2.0:1782224156.850294:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782224156.850418:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+16:8307:x1868797332978304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782224156.850641:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+16:8307:x1868797332978304:12345-0@lo:502:llog_process_th.0 Request processed in 227us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224156.850649:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1782224156.850848:0:8307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8307:1868797332978304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782224156.850883:0:8307:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782224156.850893:0:8307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224156.850895:0:8307:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782224156.850901:0:8307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782224156.850928:0:8307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8307:1868797332978432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224156.850967:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224156.851001:0:8307:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90e9ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1782224156.851136:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332978432 00000100:00100000:2.0:1782224156.851140:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332978432 00000100:00100000:2.0:1782224156.851175:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782224156.851181:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+16:8307:x1868797332978432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782224156.851289:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+16:8307:x1868797332978432:12345-0@lo:502:llog_process_th.0 Request processed in 108us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224156.851296:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1782224156.851553:0:8307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8307:1868797332978432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782224156.851571:0:8307:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782224156.851576:0:8307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224156.851577:0:8307:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782224156.851581:0:8307:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1782224156.851866:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1782224156.851885:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1782224156.851897:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90674c00/0xcfd8b3ae4b16490a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164911 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.851910:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea90674c00/0xcfd8b3ae4b16490a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164911 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224156.851921:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782224156.851924:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff96ea982ae000 from 39 10000000:01000000:2.0:1782224156.851934:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782224156.851964:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb610000/0xcfd8b3ae4b164918 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.851972:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabb610000/0xcfd8b3ae4b164918 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.851992:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabb610000/0xcfd8b3ae4b164918 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224156.852010:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332978560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782224156.852069:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.852102:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8352c300 going to sleep for 11 seconds 00000100:00100000:0.0:1782224156.852174:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332978560 00000100:00100000:0.0:1782224156.852180:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332978560 00000100:00100000:0.0:1782224156.852213:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782224156.852221:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+16:5783:x1868797332978560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782224156.852240:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224156.852254:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbb87a00/0xcfd8b3ae4b16491f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b164918 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224156.852279:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbb87a00/0xcfd8b3ae4b16491f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164918 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224156.852290:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbb87a00/0xcfd8b3ae4b16491f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164918 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224156.852309:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbb87a00, rc 0) 00000100:00100000:0.0:1782224156.852363:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332978560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224156.852370:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782224156.852624:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332978560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782224156.852639:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabb610000/0xcfd8b3ae4b164918 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16491f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.852649:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabb610000/0xcfd8b3ae4b164918 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b16491f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224156.852696:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332978688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782224156.852719:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.852744:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8352c300 going to sleep for 11 seconds 00000100:00100000:0.0:1782224156.852789:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332978688 00000100:00100000:0.0:1782224156.852793:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332978688 00000100:00100000:0.0:1782224156.852821:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782224156.852827:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332978688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782224156.853390:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332978688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 561us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224156.853399:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782224156.853461:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332978688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782224156.853490:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332978816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782224156.853525:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.853550:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8352c300 going to sleep for 11 seconds 00000100:00100000:1.0:1782224156.853591:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332978816 00000100:00100000:1.0:1782224156.853600:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332978816 00000100:00100000:1.0:1782224156.853632:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1782224156.853639:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332978816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782224156.853802:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332978816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224156.853809:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1782224156.853870:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332978816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782224156.854291:0:8308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f53b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8308:1868797332978944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782224156.854340:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224156.854356:0:8308:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaaa254180 going to sleep for 11 seconds 00000100:00100000:2.0:1782224156.854455:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332978944 00000100:00100000:2.0:1782224156.854459:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332978944 00000100:00100000:2.0:1782224156.854488:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1782224156.854495:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+17:8308:x1868797332978944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782224156.854694:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+17:8308:x1868797332978944:12345-0@lo:502:llog_process_th.0 Request processed in 199us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224156.854701:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782224156.855911:0:8308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f53b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8308:1868797332978944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224156.855984:0:8308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8308:1868797332979072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224156.856154:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224156.856190:0:8308:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90e9ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1782224156.856230:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332979072 00000100:00100000:2.0:1782224156.856236:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332979072 00000100:00100000:2.0:1782224156.856284:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1782224156.856294:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+17:8308:x1868797332979072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782224156.856558:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+17:8308:x1868797332979072:12345-0@lo:502:llog_process_th.0 Request processed in 265us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224156.856566:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1782224156.856706:0:8308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8308:1868797332979072:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782224156.856727:0:8308:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1782224156.856980:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1782224156.857011:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782224156.857111:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb610000/0xcfd8b3ae4b164918 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16491f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.857125:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabb610000/0xcfd8b3ae4b164918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16491f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224156.857135:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782224156.857138:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1782224156.857141:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782224156.857171:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b164926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.857179:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b164926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.857195:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b164926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224156.857211:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc898a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332979200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782224156.857242:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.857260:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8352c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224156.857373:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332979200 00000100:00100000:0.0:1782224156.857378:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332979200 00000100:00100000:0.0:1782224156.857419:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782224156.857427:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332979200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782224156.857438:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224156.857542:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbb87c00/0xcfd8b3ae4b16492d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b164926 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224156.857583:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbb87c00/0xcfd8b3ae4b16492d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164926 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224156.857596:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbb87c00/0xcfd8b3ae4b16492d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164926 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224156.857607:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbb87c00, rc 0) 00000100:00100000:0.0:1782224156.858047:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332979200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 588us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224156.858055:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1782224156.858237:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc898a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332979200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782224156.858253:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b164926 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16492d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.858264:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b164926 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b16492d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224156.858412:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc898a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332979328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782224156.858457:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.858516:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8352c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782224156.858602:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332979328 00000100:00100000:1.0:1782224156.858607:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332979328 00000100:00100000:1.0:1782224156.858643:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782224156.858651:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332979328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782224156.858972:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332979328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224156.858980:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782224156.859097:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc898a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332979328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224156.859129:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332979456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224156.859165:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224156.859183:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90e9ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1782224156.859232:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332979456 00000100:00100000:0.0:1782224156.859236:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332979456 00000100:00100000:0.0:1782224156.859263:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1782224156.859270:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332979456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782224156.859617:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332979456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 346us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224156.859624:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1782224156.859769:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332979456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224156.861174:0:8309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8309:1868797332979584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224156.861250:0:8309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224156.861334:0:8309:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90e9f840 going to sleep for 11 seconds 00000100:00100000:0.0:1782224156.861956:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332979584 00000100:00100000:0.0:1782224156.861965:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332979584 00000100:00100000:0.0:1782224156.862055:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782224156.862065:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+18:8309:x1868797332979584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782224156.862658:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+18:8309:x1868797332979584:12345-0@lo:502:llog_process_th.0 Request processed in 594us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224156.862668:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1782224156.862791:0:8309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8309:1868797332979584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782224156.862828:0:8309:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782224156.862839:0:8309:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224156.862842:0:8309:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782224156.862849:0:8309:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782224156.862884:0:8309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8309:1868797332979712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224156.862924:0:8309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224156.862957:0:8309:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90e9f840 going to sleep for 11 seconds 00000100:00100000:1.0:1782224156.863006:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332979712 00000100:00100000:1.0:1782224156.863011:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332979712 00000100:00100000:1.0:1782224156.863071:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1782224156.863079:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+18:8309:x1868797332979712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782224156.863252:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+18:8309:x1868797332979712:12345-0@lo:502:llog_process_th.0 Request processed in 173us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224156.863259:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782224156.863672:0:8309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8309:1868797332979712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782224156.863703:0:8309:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782224156.863708:0:8309:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224156.863710:0:8309:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782224156.863714:0:8309:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1782224156.863891:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1782224156.863917:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782224156.863929:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b164926 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16492d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.863942:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b164926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16492d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224156.863953:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1782224156.863956:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff96ea833bcd40 from 1 10000000:01000000:2.0:1782224156.863959:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782224156.863999:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb611800/0xcfd8b3ae4b164934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.864008:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabb611800/0xcfd8b3ae4b164934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.864055:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabb611800/0xcfd8b3ae4b164934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224156.864072:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc898380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332979840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782224156.864116:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.864139:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8352cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782224156.864282:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332979840 00000100:00100000:0.0:1782224156.864287:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332979840 00000100:00100000:0.0:1782224156.864389:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782224156.864397:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332979840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782224156.864411:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224156.864425:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbb86400/0xcfd8b3ae4b16493b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b164934 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224156.864544:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbb86400/0xcfd8b3ae4b16493b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164934 expref: 19 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224156.864564:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbb86400/0xcfd8b3ae4b16493b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164934 expref: 19 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224156.864574:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbb86400, rc 0) 00000100:00100000:0.0:1782224156.864637:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797332979840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 241us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224156.864644:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1782224156.865149:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc898380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332979840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782224156.865168:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabb611800/0xcfd8b3ae4b164934 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16493b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.865177:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabb611800/0xcfd8b3ae4b164934 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b16493b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224156.865239:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc898380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332979968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782224156.865273:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224156.865403:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8352cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782224156.865441:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332979968 00000100:00100000:0.0:1782224156.865446:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332979968 00000100:00100000:0.0:1782224156.865516:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1782224156.865524:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797332979968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782224156.865822:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797332979968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (548us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782224156.865839:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1782224156.865889:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc898380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332979968:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1782224156.865916:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782224156.865922:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb611800/0xcfd8b3ae4b164934 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16493b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224156.865930:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabb611800/0xcfd8b3ae4b164934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16493b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224157.396368:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224157.718871:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224157.719050:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311980288 00000100:00100000:0.0:1782224157.719065:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311980288 00000100:00100000:0.0:1782224157.719212:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 165 00000100:00100000:0.0:1782224157.719227:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+8:5565:x1868797311980288:12345-192.168.202.7@tcp:101: 00010000:00010000:0.0:1782224157.719251:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224157.720413:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbb86a00/0xcfd8b3ae4b164942 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a514ab expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224157.720474:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbb86a00/0xcfd8b3ae4b164942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514ab expref: 9 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224157.720492:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbb86a00/0xcfd8b3ae4b164942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514ab expref: 9 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224157.720505:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbb86a00, rc 0) 00000100:00100000:0.0:1782224157.720620:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+9:5565:x1868797311980288:12345-192.168.202.7@tcp:101: Request processed in 1396us (1765us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224157.720630:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 165 00000100:00100000:1.0:1782224157.725323:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224157.725459:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311980416 00000100:00100000:0.0:1782224157.725474:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311980416 00000100:00100000:0.0:1782224157.725558:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 166 00000100:00100000:0.0:1782224157.725572:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+9:5565:x1868797311980416:12345-192.168.202.7@tcp:501: 00000100:00100000:0.0:1782224157.726342:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+9:5565:x1868797311980416:12345-192.168.202.7@tcp:501: Request processed in 768us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224157.726352:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 166 00000100:00100000:3.0:1782224157.730134:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224157.735882:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311980544 00000100:00100000:1.0:1782224157.735924:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311980544 00000100:00100000:1.0:1782224157.736009:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 167 00000100:00100000:1.0:1782224157.736048:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+9:5565:x1868797311980544:12345-192.168.202.7@tcp:503: 00000100:00100000:1.0:1782224157.741063:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+9:5565:x1868797311980544:12345-192.168.202.7@tcp:503: Request processed in 5000us (10913us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224157.741083:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 167 00000100:00100000:2.0:1782224157.751908:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224157.752319:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311980672 00000100:00100000:1.0:1782224157.752332:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311980672 00000100:00100000:1.0:1782224157.752408:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 168 00000100:00100000:1.0:1782224157.752421:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+9:6044:x1868797311980672:12345-192.168.202.7@tcp:502: 00000100:00100000:1.0:1782224157.752780:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+9:6044:x1868797311980672:12345-192.168.202.7@tcp:502: Request processed in 359us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224157.752789:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 168 00000100:00100000:0.0:1782224157.759489:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224157.759645:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311980800 00000100:00100000:1.0:1782224157.759660:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311980800 00000100:00100000:1.0:1782224157.759736:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 169 00000100:00100000:1.0:1782224157.759759:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+9:6044:x1868797311980800:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782224157.760148:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+9:6044:x1868797311980800:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 400us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224157.760162:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 169 00000100:00100000:0.0:1782224157.773191:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224157.773394:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311980928 00000100:00100000:2.0:1782224157.773410:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311980928 00000100:00100000:2.0:1782224157.773472:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 170 00000100:00100000:2.0:1782224157.773483:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+9:5565:x1868797311980928:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782224157.773506:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224157.773540:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabb611600/0xcfd8b3ae4b164949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a514b2 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224157.773578:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabb611600/0xcfd8b3ae4b164949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514b2 expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224157.773592:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabb611600/0xcfd8b3ae4b164949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514b2 expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224157.773603:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabb611600, rc 0) 00000100:00100000:2.0:1782224157.773680:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+10:5565:x1868797311980928:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 Request processed in 198us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224157.773688:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 170 00000100:00100000:3.0:1782224157.788095:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224157.788234:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311981056 00000100:00100000:2.0:1782224157.788248:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311981056 00000100:00100000:2.0:1782224157.788323:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 171 00000100:00100000:2.0:1782224157.788336:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+10:5565:x1868797311981056:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782224157.788816:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+10:5565:x1868797311981056:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 Request processed in 479us (733us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782224157.788826:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 171 00010000:00010000:0.0:1782224158.420319:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224158.808544:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332980096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782224158.808645:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224158.809250:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332980096 00000100:00100000:1.0:1782224158.809259:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332980096 00000100:00080000:0.0:1782224158.809469:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782224158.809516:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782224158.809530:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332980096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782224158.809648:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224158.809722:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332980096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 197us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224158.809760:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1782224158.809858:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea83f50380 x1868797332980096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224158.809914:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332980096:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782224159.449458:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782224159.702769:0:8346:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe44e6e990 20000000:00000080:3.0:1782224159.705451:0:8346:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96e984d33000 uarg=0000000000000000 20000000:01000000:3.0:1782224159.705513:0:8346:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1782224159.705521:0:8346:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1782224159.705528:0:8346:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1782224159.719577:0:8347:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1782224159.719780:0:8346:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1782224159.732197:0:8346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1782224159.732240:0:8346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1782224159.732275:0:8346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1782224159.732290:0:8346:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782224159.732312:0:8346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164950 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224159.732329:0:8346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96eabb711000/0xcfd8b3ae4b1646c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1646be expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224159.732336:0:8346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea80031c00/0xcfd8b3ae4b164727 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164720 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224159.732340:0:8346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b1647f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1647eb expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224159.732348:0:8346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea90675800/0xcfd8b3ae4b1648af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5147a expref: 9 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224159.732353:0:8346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164950 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224159.732469:0:8346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea90675800/0xcfd8b3ae4b1648af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5147a expref: 9 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224159.732482:0:8346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96ea90675800/0xcfd8b3ae4b1648af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5147a expref: 9 pid: 5781 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224159.732496:0:8346:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f51500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8346:1868797332980224:192.168.202.7@tcp:104: 00010000:00010000:1.0:1782224159.732634:0:8346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b1647f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b1647eb expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224159.732643:0:8346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b1647f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1647eb expref: 18 pid: 5781 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224159.732653:0:8346:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f53100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8346:1868797332980352:0@lo:104: 00000100:00100000:1.0:1782224159.732694:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782224159.733182:0:8346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea80031c00/0xcfd8b3ae4b164727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b164720 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224159.733204:0:8346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96ea80031c00/0xcfd8b3ae4b164727 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164720 expref: 18 pid: 5781 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224159.733238:0:8346:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8346:1868797332980480:0@lo:104: 00000100:00100000:3.0:1782224159.745001:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332980352 00000100:00100000:3.0:1782224159.745035:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332980352 00000100:00100000:1.0:1782224159.745750:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224159.747125:0:5768:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1782224159.747153:0:8346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96eabb711000/0xcfd8b3ae4b1646c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b1646be expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224159.747159:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332980480 00000100:00100000:3.0:1782224159.747169:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332980480 00010000:00010000:1.0:1782224159.747176:0:8346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96eabb711000/0xcfd8b3ae4b1646c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1646be expref: 18 pid: 5780 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224159.747197:0:8346:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8346:1868797332980608:0@lo:104: 00000100:00100000:3.0:1782224159.747210:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782224159.747224:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+4:8346:x1868797332980352:12345-0@lo:104: 00010000:00010000:3.0:1782224159.747244:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eabb610200/0xcfd8b3ae4b1647eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1647f2 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224159.747284:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224159.747301:0:8346:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea831d3840 going to sleep for 11 seconds 00000100:00100000:1.0:1782224159.747338:0:8346:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f51500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8346:1868797332980224:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224159.747352:0:8346:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f53100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8346:1868797332980352:0@lo:104: 00010000:00010000:3.0:1782224159.747353:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782224159.747364:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+4:8346:x1868797332980352:12345-0@lo:104: Request processed in 141us (14667us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224159.747374:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1782224159.747464:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782224159.747472:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabb610200/0xcfd8b3ae4b1647eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1647f2 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224159.747480:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabb610200 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:3.0:1782224159.747485:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabb610200/0xcfd8b3ae4b1647eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b1647f2 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224159.747496:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabb610200/0xcfd8b3ae4b1647eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b1647f2 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782224159.747504:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabb610200/0xcfd8b3ae4b1647eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b1647f2 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224159.747511:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782224159.747557:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabb610200/0xcfd8b3ae4b1647eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1647f2 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224159.747564:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782224159.747598:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabb610200/0xcfd8b3ae4b1647eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1647f2 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224159.747681:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabb610200/0xcfd8b3ae4b1647eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1647f2 expref: -99 pid: 7469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224159.747713:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224159.747715:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224159.747716:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224159.747765:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332980608 00000100:00100000:3.0:1782224159.747770:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332980608 00000100:00100000:2.0:1782224159.747822:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797332980736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782224159.747859:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782224159.747869:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+4:8346:x1868797332980480:12345-0@lo:104: 00010000:00010000:3.0:1782224159.747878:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b164720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164727 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224159.747919:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782224159.747925:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+4:8346:x1868797332980480:12345-0@lo:104: Request processed in 58us (2183us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224159.747933:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1782224159.747942:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782224159.747948:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b164720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164727 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.747954:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabb610800 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:2.0:1782224159.747957:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b164720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b164727 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.747962:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b164720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b164727 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782224159.747967:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b164720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b164727 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224159.747970:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782224159.747986:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b164720 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164727 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.747989:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782224159.748002:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b164720 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164727 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.748006:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b164720 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164727 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.748029:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224159.748030:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224159.748031:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224159.748039:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332980864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782224159.748071:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782224159.748080:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+3:8346:x1868797332980608:12345-0@lo:104: 00010000:00010000:3.0:1782224159.748088:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1646be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1646c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224159.748129:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782224159.748134:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+3:8346:x1868797332980608:12345-0@lo:104: Request processed in 56us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224159.748140:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782224159.748238:0:8346:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8346:1868797332980480:0@lo:104: 00000100:00100000:1.0:1782224159.748246:0:8346:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8346:1868797332980608:0@lo:104: 00010000:00010000:1.0:1782224159.748282:0:8346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164950 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.748330:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782224159.748334:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1646be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1646c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.748340:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876600 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:2.0:1782224159.748344:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1646be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b1646c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.748350:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1646be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b1646c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782224159.748355:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1646be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b1646c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224159.748360:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782224159.748386:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1646be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1646c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.748392:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782224159.748417:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1646be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1646c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.748424:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1646be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1646c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224159.748435:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332980992:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782224159.748438:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224159.748442:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224159.748444:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224159.748630:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224159.748694:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224159.748698:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311981184 00000100:00100000:1.0:1782224159.748705:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311981184 00010000:00010000:1.0:1782224159.748746:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea90675800/0xcfd8b3ae4b1648af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5147a expref: 10 pid: 5781 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224159.748780:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332980992 00000100:00100000:1.0:1782224159.748785:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332980992 00010000:00010000:1.0:1782224159.748801:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96eabb711000/0xcfd8b3ae4b1646c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1646be expref: 19 pid: 5780 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224159.748810:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:0.0:1782224159.748835:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2347:x1868797311981184:12345-192.168.202.7@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782224159.748847:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782224159.748861:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224159.748875:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea90675800/0xcfd8b3ae4b1648af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5147a expref: 10 pid: 5781 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224159.748903:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332980864 00010000:00010000:0.0:1782224159.748910:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea90675800/0xcfd8b3ae4b1648af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5147a expref: 10 pid: 5781 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224159.748912:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224159.748922:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332980864 00000100:00100000:2.0:1782224159.748945:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332980736 00010000:00010000:0.0:1782224159.748952:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90675800/0xcfd8b3ae4b1648af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5147a expref: 10 pid: 5781 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224159.748955:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332980736 00010000:00010000:2.0:1782224159.748973:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b1647f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1647eb expref: 21 pid: 5781 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224159.748978:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782224159.749091:0:8291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea80031c00/0xcfd8b3ae4b164727 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164720 expref: 21 pid: 5781 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224159.749111:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4fff53da-03fa-4566-9f6c-b379e18824a7+9:2347:x1868797311981184:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 283us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224159.749924:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782224159.749938:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+21:3306:x1868797332980992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782224159.749954:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224159.749961:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96eabb711000/0xcfd8b3ae4b1646c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1646be expref: 21 pid: 5780 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224159.749973:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96eabb711000/0xcfd8b3ae4b1646c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1646be expref: 21 pid: 5780 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224159.749988:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabb711000/0xcfd8b3ae4b1646c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b1646be expref: 21 pid: 5780 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224159.750003:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224159.750091:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b33607d9-62cb-4729-8187-59883763158a+20:3306:x1868797332980992:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224159.750099:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782224159.750297:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782224159.750308:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782224159.750312:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc898000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b33607d9-62cb-4729-8187-59883763158a+19:3304:x1868797332980736:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782224159.750326:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc89bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332980864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782224159.750327:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224159.750336:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b1647f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1647eb expref: 19 pid: 5781 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224159.750342:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782224159.750351:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 21 00010000:00010000:3.0:1782224159.750358:0:8291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea80031c00/0xcfd8b3ae4b164727 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164720 expref: 19 pid: 5781 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.750361:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b1647f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1647eb expref: 19 pid: 5781 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224159.750386:0:8291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea80031c00/0xcfd8b3ae4b164727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b164720 expref: 19 pid: 5781 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.750489:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea99877a00/0xcfd8b3ae4b1647f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b1647eb expref: 19 pid: 5781 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224159.750493:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea80031c00/0xcfd8b3ae4b164727 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b164720 expref: 19 pid: 5781 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.750507:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164950 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.750519:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164950 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224159.750527:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224159.750539:0:5771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164950 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.750548:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164950 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.750556:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164950 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.750562:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164950 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.750584:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876c00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:2.0:1782224159.750590:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164950 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.750600:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164950 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.750615:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164950 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224159.750629:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224159.750640:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc89bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b33607d9-62cb-4729-8187-59883763158a+17:3305:x1868797332980864:12345-0@lo:103:ldlm_bl.0 Request processed in 320us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224159.750648:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782224159.750668:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc898000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b33607d9-62cb-4729-8187-59883763158a+16:3304:x1868797332980736:12345-0@lo:103:ldlm_bl.0 Request processed in 360us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224159.750676:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782224159.750710:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332980992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782224159.750736:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797332980736:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782224159.750841:0:8346:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164950 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224159.750855:0:8346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164950 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224159.750861:0:8346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea99876c00/0xcfd8b3ae4b164950 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224159.750906:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332980864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782224159.828466:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332981376:0@lo:400:kworker.0 00000100:00100000:2.0:1782224159.828686:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332981120:0@lo:400:kworker.0 00000100:00100000:3.0:1782224159.829064:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797332981248:0@lo:400:kworker.0 00000100:00100000:2.0:1782224159.834391:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224159.834454:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332981632:0@lo:400:kworker.0 00000100:00100000:1.0:1782224159.836057:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224159.836129:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224159.836160:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782224159.836177:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332981504:0@lo:400:kworker.0 00000100:00100000:2.0:1782224159.836229:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332981120 00000100:00100000:2.0:1782224159.836239:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332981120 00000100:00100000:2.0:1782224159.836302:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782224159.836313:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc89b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332981120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224159.836384:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc89b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332981120:12345-0@lo:400:kworker.0 Request processed in 73us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224159.836392:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782224159.836872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224159.836939:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332981376 00000100:00100000:1.0:1782224159.836949:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332981376 00000100:00100000:1.0:1782224159.837001:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332981632 00000100:00100000:1.0:1782224159.837005:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332981632 00000100:00100000:1.0:1782224159.837071:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782224159.837080:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332981376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224159.837143:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332981376:12345-0@lo:400:kworker.0 Request processed in 64us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224159.837151:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782224159.837173:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782224159.837180:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332981632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224159.837229:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332981632:12345-0@lo:400:kworker.0 Request processed in 50us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224159.837546:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332981504 00000100:00100000:2.0:1782224159.837555:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332981504 00000100:00100000:2.0:1782224159.837608:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782224159.837621:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332981504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224159.837689:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332981504:12345-0@lo:400:kworker.0 Request processed in 74us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224159.837696:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782224159.837773:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332981120:0@lo:400:kworker.0 00010000:00080000:2.0:1782224159.837797:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea83f53b80 x1868797332981632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224159.837810:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332981632:0@lo:400:kworker.0 00000100:00100000:1.0:1782224159.838276:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1782224159.838663:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782224159.838671:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782224159.838807:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332981504:0@lo:400:kworker.0 00010000:00080000:1.0:1782224159.838827:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea83f53100 x1868797332981376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224159.838837:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332981376:0@lo:400:kworker.0 00000100:00100000:3.0:1782224159.846694:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224159.846761:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332981248 00000100:00100000:2.0:1782224159.846772:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332981248 00000100:00100000:2.0:1782224159.846851:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782224159.846861:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797332981248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224159.846934:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797332981248:12345-0@lo:400:kworker.0 Request processed in 74us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224159.846941:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1782224159.846968:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224159.847001:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797332981248:0@lo:400:kworker.0 00000100:00100000:3.0:1782224160.344927:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332981760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782224160.345071:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224160.345159:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332981760 00000100:00100000:3.0:1782224160.345169:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332981760 00000100:00100000:3.0:1782224160.345243:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782224160.345271:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332981760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782224160.345318:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224160.345371:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332981760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224160.345379:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1782224160.345427:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabba6ea00 x1868797332981760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224160.345450:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332981760:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782224160.468534:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224161.303566:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224161.303621:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224161.303655:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224161.303697:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224161.303940:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311981440 00000100:00100000:0.0:1782224161.303950:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311981440 00000100:00100000:0.0:1782224161.304042:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:0.0:1782224161.304052:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2348:x1868797311981440:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224161.304132:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2348:x1868797311981440:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 82us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224161.304140:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00080000:0.0:1782224161.304162:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224161.304335:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311981568 00000100:00100000:3.0:1782224161.304340:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311981568 00000100:00100000:3.0:1782224161.304379:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311981696 00000100:00100000:3.0:1782224161.304382:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311981696 00000100:00100000:3.0:1782224161.304402:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:3.0:1782224161.304409:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2348:x1868797311981568:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224161.304438:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2348:x1868797311981568:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 30us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224161.304446:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:3.0:1782224161.304459:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:3.0:1782224161.304465:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2348:x1868797311981696:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224161.304488:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2348:x1868797311981696:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 24us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224161.304493:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00080000:3.0:1782224161.304506:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782224161.304508:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782224161.306291:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311981312 00000100:00100000:1.0:1782224161.306302:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311981312 00000100:00100000:1.0:1782224161.306357:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 172 00000100:00100000:1.0:1782224161.306367:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+9:2348:x1868797311981312:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224161.306429:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+9:2348:x1868797311981312:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 63us (2874us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224161.306437:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 172 00000100:00100000:3.0:1782224161.485276:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224161.485605:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311981824 00000100:00100000:2.0:1782224161.485625:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311981824 00000100:00100000:2.0:1782224161.485689:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 173 00000100:00100000:2.0:1782224161.485700:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+9:5565:x1868797311981824:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782224161.485727:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224161.485759:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabb610600/0xcfd8b3ae4b164957 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a514b9 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224161.485804:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabb610600/0xcfd8b3ae4b164957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514b9 expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224161.485816:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabb610600/0xcfd8b3ae4b164957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514b9 expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224161.485826:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabb610600, rc 0) 00000100:00100000:2.0:1782224161.485893:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+10:5565:x1868797311981824:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 Request processed in 195us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224161.485901:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 173 00000100:00100000:2.0:1782224161.487969:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224161.488068:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311981952 00000100:00100000:3.0:1782224161.488078:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311981952 00000100:00100000:3.0:1782224161.488131:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 174 00000100:00100000:3.0:1782224161.488142:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+10:5565:x1868797311981952:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224161.488460:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+10:5565:x1868797311981952:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 Request processed in 319us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224161.488468:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 174 00000100:00100000:3.0:1782224161.490158:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224161.490605:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311982080 00000100:00100000:1.0:1782224161.490625:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311982080 00000100:00100000:1.0:1782224161.490680:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 175 00000100:00100000:1.0:1782224161.490690:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+10:5565:x1868797311982080:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782224161.490951:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+10:5565:x1868797311982080:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 Request processed in 261us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224161.490960:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 175 10000000:01000000:1.0:1782224161.492089:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782224161.492095:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96eabfbe5800 from 4 10000000:01000000:1.0:1782224161.492100:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782224161.492108:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224161.492151:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16495e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224161.492164:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16495e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224161.492176:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16495e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224161.492202:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332981888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782224161.492445:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224161.492497:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea983f5900 going to sleep for 11 seconds 00000100:00100000:3.0:1782224161.492504:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332981888 00000100:00100000:3.0:1782224161.492512:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332981888 00000100:00100000:3.0:1782224161.492563:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1782224161.492572:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+16:5783:x1868797332981888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782224161.492585:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224161.492599:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea90674e00/0xcfd8b3ae4b164965 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b16495e expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224161.492621:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90674e00/0xcfd8b3ae4b164965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16495e expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224161.492632:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea90674e00/0xcfd8b3ae4b164965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16495e expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224161.492641:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674e00, rc 0) 00000100:00100000:3.0:1782224161.492694:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332981888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224161.492702:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1782224161.492770:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332981888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782224161.492797:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16495e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164965 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224161.492806:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16495e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164965 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224161.492872:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332982016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782224161.492901:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224161.492927:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea831d3840 going to sleep for 11 seconds 00000100:00100000:3.0:1782224161.493053:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332982016 00000100:00100000:3.0:1782224161.493058:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332982016 00000100:00100000:3.0:1782224161.493096:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1782224161.493103:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332982016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224161.493694:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332982016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 589us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224161.493701:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1782224161.493763:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332982016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782224161.493953:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332982144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782224161.494002:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224161.494049:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea831d3840 going to sleep for 11 seconds 00000100:00100000:3.0:1782224161.494128:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332982144 00000100:00100000:3.0:1782224161.494133:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332982144 00000100:00100000:3.0:1782224161.494163:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1782224161.494170:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332982144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224161.494325:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332982144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224161.494332:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1782224161.494737:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332982144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782224161.495281:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224161.495316:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311982208 00000100:00100000:1.0:1782224161.495322:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311982208 00000100:00100000:1.0:1782224161.495360:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 179 00000100:00100000:1.0:1782224161.495381:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+10:6108:x1868797311982208:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782224161.495600:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+10:6108:x1868797311982208:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 230us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224161.495609:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 179 00000100:00100000:3.0:1782224161.495939:0:8419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8419:1868797332982272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224161.495987:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224161.496052:0:8419:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabba9eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782224161.496098:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332982272 00000100:00100000:2.0:1782224161.496102:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332982272 00000100:00100000:2.0:1782224161.496132:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1782224161.496139:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+17:8419:x1868797332982272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782224161.496289:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+17:8419:x1868797332982272:12345-0@lo:502:llog_process_th.0 Request processed in 150us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224161.496297:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1782224161.497342:0:8419:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8419:1868797332982272:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782224161.497384:0:8419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782224161.497396:0:8419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224161.497398:0:8419:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782224161.497410:0:8419:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96eabfbe5800 00000020:00000080:0.0:1782224161.497413:0:8419:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782224161.497499:0:8419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8419:1868797332982400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782224161.497563:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224161.497615:0:8419:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90ec29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782224161.497698:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332982400 00000100:00100000:3.0:1782224161.497705:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332982400 00000100:00100000:3.0:1782224161.497756:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782224161.497766:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+17:8419:x1868797332982400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224161.498190:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+17:8419:x1868797332982400:12345-0@lo:502:llog_process_th.0 Request processed in 424us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224161.498198:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1782224161.499347:0:8419:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8419:1868797332982400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782224161.499388:0:8419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782224161.499397:0:8419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224161.499399:0:8419:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1782224161.499406:0:8419:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1782224161.499575:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1782224161.499599:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782224161.499611:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16495e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164965 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224161.499691:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16495e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164965 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224161.499701:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782224161.499704:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96ea8341a800 from 4 10000000:01000000:2.0:1782224161.499707:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782224161.499749:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b16496c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224161.499758:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b16496c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224161.499767:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b16496c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224161.499800:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332982528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782224161.499853:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224161.499891:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea831d3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782224161.499942:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332982528 00000100:00100000:3.0:1782224161.499949:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332982528 00000100:00100000:3.0:1782224161.499995:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1782224161.500005:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332982528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782224161.500055:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224161.500068:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b164973 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b16496c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224161.500093:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b164973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16496c expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224161.500103:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b164973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16496c expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224161.500112:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675a00, rc 0) 00000100:00100000:3.0:1782224161.500163:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332982528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224161.500170:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1782224161.500267:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332982528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782224161.500280:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b16496c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164973 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224161.500288:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b16496c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164973 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224161.500335:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332982656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782224161.500361:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224161.500785:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90ec29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782224161.509724:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332982656 00000100:00100000:3.0:1782224161.509742:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332982656 00000100:00100000:3.0:1782224161.510455:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782224161.510469:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332982656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224161.510815:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332982656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (10450us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224161.510823:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782224161.510893:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332982656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224161.510951:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332982784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224161.511000:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224161.511051:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8352c900 going to sleep for 11 seconds 00000100:00100000:3.0:1782224161.511064:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332982784 00000100:00100000:3.0:1782224161.511068:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332982784 00000100:00100000:3.0:1782224161.511100:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1782224161.511107:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332982784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224161.511283:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332982784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224161.511290:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1782224161.511327:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332982784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224161.511552:0:8422:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8422:1868797332982912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224161.511591:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224161.511611:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332982912 00000100:00100000:3.0:1782224161.511615:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332982912 00000100:00100000:3.0:1782224161.511635:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1782224161.511641:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:8422:x1868797332982912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224161.511786:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:8422:x1868797332982912:12345-0@lo:502:llog_process_th.0 Request processed in 144us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224161.511792:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1782224161.511822:0:8422:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8352c300 going to sleep for 11 seconds 00000100:00100000:3.0:1782224161.511834:0:8422:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8422:1868797332982912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782224161.511852:0:8422:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782224161.511863:0:8422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224161.511865:0:8422:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782224161.511873:0:8422:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96ea8341a800 00000020:00000080:3.0:1782224161.511877:0:8422:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782224161.512394:0:8422:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8422:1868797332983040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224161.512438:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224161.512463:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332983040 00000100:00100000:3.0:1782224161.512473:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332983040 00000100:00100000:3.0:1782224161.512500:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1782224161.512507:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:8422:x1868797332983040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224161.512645:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:8422:x1868797332983040:12345-0@lo:502:llog_process_th.0 Request processed in 138us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224161.512652:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1782224161.512680:0:8422:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc8b6000 going to sleep for 11 seconds 00000100:00100000:3.0:1782224161.512693:0:8422:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8422:1868797332983040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782224161.512726:0:8422:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782224161.512731:0:8422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224161.512733:0:8422:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782224161.512738:0:8422:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782224161.512789:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782224161.512809:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782224161.512820:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b16496c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164973 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224161.512832:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b16496c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164973 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224161.512844:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782224161.512846:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96ea982ae000 from 4 10000000:01000000:3.0:1782224161.512849:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782224161.512874:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675c00/0xcfd8b3ae4b16497a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224161.512882:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea90675c00/0xcfd8b3ae4b16497a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224161.512891:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea90675c00/0xcfd8b3ae4b16497a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224161.512910:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332983168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782224161.512938:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224161.512953:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc8b6000 going to sleep for 11 seconds 00000100:00100000:3.0:1782224161.512966:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332983168 00000100:00100000:3.0:1782224161.512969:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332983168 00000100:00100000:3.0:1782224161.512988:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1782224161.512993:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332983168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782224161.513003:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224161.513039:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b164981 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b16497a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224161.513061:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b164981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16497a expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224161.513070:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b164981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16497a expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224161.513078:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674400, rc 0) 00000100:00100000:3.0:1782224161.513105:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797332983168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224161.513110:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1782224161.513137:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332983168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782224161.513149:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea90675c00/0xcfd8b3ae4b16497a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164981 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224161.513158:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea90675c00/0xcfd8b3ae4b16497a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164981 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224161.513208:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332983296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224161.513233:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224161.513246:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc8b6000 going to sleep for 11 seconds 00000100:00100000:3.0:1782224161.513257:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332983296 00000100:00100000:3.0:1782224161.513260:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332983296 00000100:00100000:3.0:1782224161.513278:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1782224161.513284:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797332983296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224161.513493:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797332983296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224161.513500:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1782224161.513528:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332983296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224161.513551:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332983424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224161.513589:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224161.513603:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc8b6000 going to sleep for 11 seconds 00000100:00100000:3.0:1782224161.513615:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332983424 00000100:00100000:3.0:1782224161.513618:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332983424 00000100:00100000:3.0:1782224161.513634:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1782224161.513639:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797332983424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224161.527156:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797332983424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 13505us (13556us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224161.527173:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1782224161.527253:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332983424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782224161.527368:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224161.527446:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311982336 00000100:00100000:3.0:1782224161.527458:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311982336 00000100:00100000:3.0:1782224161.527509:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 190 00000100:00100000:3.0:1782224161.527520:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+10:6108:x1868797311982336:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782224161.527756:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+10:6108:x1868797311982336:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 237us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224161.527763:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 190 00000100:00100000:2.0:1782224161.528834:0:8424:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8424:1868797332983552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782224161.528902:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224161.528949:0:8424:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaadb39540 going to sleep for 11 seconds 00000100:00100000:0.0:1782224161.529064:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332983552 00000100:00100000:0.0:1782224161.529071:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332983552 00000100:00100000:0.0:1782224161.529111:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1782224161.529120:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:8424:x1868797332983552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782224161.529352:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:8424:x1868797332983552:12345-0@lo:502:llog_process_th.0 Request processed in 232us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224161.529360:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1782224161.530517:0:8424:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8424:1868797332983552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782224161.530561:0:8424:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782224161.530574:0:8424:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224161.530577:0:8424:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1782224161.530586:0:8424:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96ea982ae000 00000020:00000080:2.0:1782224161.530589:0:8424:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782224161.530669:0:8424:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8424:1868797332983680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782224161.530751:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224161.530783:0:8424:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaadb39540 going to sleep for 11 seconds 00000100:00100000:3.0:1782224161.531141:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332983680 00000100:00100000:3.0:1782224161.531149:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332983680 00000100:00100000:3.0:1782224161.531195:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1782224161.531205:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea90c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:8424:x1868797332983680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224161.531492:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea90c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:8424:x1868797332983680:12345-0@lo:502:llog_process_th.0 Request processed in 288us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224161.531501:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1782224161.532229:0:8424:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:8424:1868797332983680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782224161.532266:0:8424:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782224161.532275:0:8424:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224161.532277:0:8424:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1782224161.532283:0:8424:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782224161.532480:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782224161.532500:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782224161.532512:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675c00/0xcfd8b3ae4b16497a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164981 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224161.532523:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea90675c00/0xcfd8b3ae4b16497a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164981 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224162.516397:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224163.541501:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224163.924290:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332983808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782224163.924410:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224163.924555:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332983808 00000100:00100000:0.0:1782224163.924575:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332983808 00000100:00100000:0.0:1782224163.924673:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782224163.924683:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332983808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782224163.924755:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782224163.926349:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332983808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1659us (1932us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224163.926362:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1782224163.926726:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782224163.926837:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc88ed80 x1868797332983808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224163.926887:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332983808:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782224164.567167:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224164.949997:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332983936:0@lo:400:kworker.0 00000100:00100000:2.0:1782224164.949999:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332984320:0@lo:400:kworker.0 00000100:00100000:3.0:1782224164.950127:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224164.950128:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224164.950189:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332984448:0@lo:400:kworker.0 00000100:00100000:3.0:1782224164.950269:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224164.950315:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332984064:0@lo:400:kworker.0 00000100:00100000:3.0:1782224164.950357:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224164.950375:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332984576:0@lo:400:kworker.0 00000100:00100000:3.0:1782224164.950394:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224164.950412:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782224164.950418:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332984192:0@lo:400:kworker.0 00000100:00100000:3.0:1782224164.950438:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224164.950473:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332983936 00000100:00100000:3.0:1782224164.950481:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332983936 00000100:00100000:3.0:1782224164.950534:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1782224164.950543:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea90c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797332983936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224164.950613:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea90c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797332983936:12345-0@lo:400:kworker.0 Request processed in 70us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224164.950620:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1782224164.950661:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332984320 00000100:00100000:3.0:1782224164.950664:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332984320 00000100:00100000:3.0:1782224164.950711:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332984576 00000100:00100000:3.0:1782224164.950714:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332984576 00000100:00100000:3.0:1782224164.950751:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782224164.950758:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332984320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224164.950790:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332984320:12345-0@lo:400:kworker.0 Request processed in 34us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224164.950796:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782224164.950807:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782224164.950814:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332984576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224164.950845:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332984576:12345-0@lo:400:kworker.0 Request processed in 32us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224164.950859:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782224164.950879:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332984448 00000100:00100000:3.0:1782224164.950883:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332984448 00000100:00100000:3.0:1782224164.950922:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332984064 00000100:00100000:3.0:1782224164.950926:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332984064 00000100:00100000:3.0:1782224164.950938:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332984192 00000100:00100000:3.0:1782224164.950940:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332984192 00000100:00100000:3.0:1782224164.950958:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782224164.950964:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332984448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224164.950996:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332984448:12345-0@lo:400:kworker.0 Request processed in 33us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224164.951001:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782224164.951032:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782224164.951039:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332984064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224164.951063:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332984064:12345-0@lo:400:kworker.0 Request processed in 26us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224164.951068:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782224164.951080:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782224164.951086:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332984192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224164.951109:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332984192:12345-0@lo:400:kworker.0 Request processed in 24us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224164.951113:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1782224164.951133:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782224164.951138:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782224164.951180:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332984192:0@lo:400:kworker.0 00000100:00100000:3.0:1782224164.951192:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332984064:0@lo:400:kworker.0 00010000:00080000:3.0:1782224164.951215:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc89a300 x1868797332984576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224164.951226:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332984576:0@lo:400:kworker.0 00000100:00100000:3.0:1782224164.951259:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332983936:0@lo:400:kworker.0 00000100:00100000:3.0:1782224164.951269:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332984448:0@lo:400:kworker.0 00010000:00080000:2.0:1782224164.954928:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc898e00 x1868797332984320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224164.954951:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332984320:0@lo:400:kworker.0 00000100:00100000:3.0:1782224165.465480:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332984704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782224165.465584:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224165.466598:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332984704 00000100:00100000:3.0:1782224165.466611:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332984704 00000100:00100000:3.0:1782224165.466842:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782224165.466854:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332984704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782224165.466899:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224165.466974:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332984704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224165.466982:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1782224165.467462:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabfa90000 x1868797332984704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224165.467487:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332984704:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782224165.588955:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224166.418281:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224166.418327:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224166.418352:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224166.418371:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224166.418440:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311982464 00000100:00100000:3.0:1782224166.418453:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311982464 00000100:00100000:3.0:1782224166.418553:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 194 00000100:00100000:3.0:1782224166.418566:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea90c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2347:x1868797311982464:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224166.418799:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea90c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2347:x1868797311982464:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 234us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224166.418821:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 194 00000100:00100000:3.0:1782224166.418925:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311982720 00000100:00100000:3.0:1782224166.418930:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311982720 00000100:00100000:3.0:1782224166.418980:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311982848 00000100:00100000:3.0:1782224166.418983:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311982848 00000100:00080000:2.0:1782224166.419093:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782224166.419163:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:3.0:1782224166.419170:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2347:x1868797311982720:12345-192.168.202.7@tcp:400:kworker.0 00000100:00080000:2.0:1782224166.419259:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782224166.419313:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2347:x1868797311982720:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 142us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224166.419321:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:3.0:1782224166.419335:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:3.0:1782224166.419342:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc89b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2347:x1868797311982848:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224166.419538:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc89b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2347:x1868797311982848:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 195us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224166.419545:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:3.0:1782224166.419755:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311982592 00000100:00100000:3.0:1782224166.419761:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311982592 00000100:00100000:3.0:1782224166.419844:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00100000:3.0:1782224166.419852:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797311982592:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224166.419884:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797311982592:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 33us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224166.419890:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00080000:2.0:1782224166.420515:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782224166.612515:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782224167.349385:0:8648:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1782224167.636316:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224168.660298:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224169.044411:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332984832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782224169.044513:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224169.044578:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332984832 00000100:00100000:3.0:1782224169.044589:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332984832 00000100:00100000:3.0:1782224169.044691:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782224169.044717:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332984832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782224169.044764:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224169.044825:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332984832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224169.044833:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1782224169.044954:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782224169.045308:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc88ce00 x1868797332984832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224169.045332:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332984832:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782224169.685392:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224170.069093:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332985088:0@lo:400:kworker.0 00000100:00100000:2.0:1782224170.069296:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332985344:0@lo:400:kworker.0 00000100:00100000:2.0:1782224170.069442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224170.069525:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782224170.069532:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332984960:0@lo:400:kworker.0 00000100:00100000:2.0:1782224170.069886:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224170.069924:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332985472:0@lo:400:kworker.0 00000100:00100000:2.0:1782224170.069955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224170.069995:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332985344 00000100:00100000:2.0:1782224170.070005:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332985344 00000100:00100000:2.0:1782224170.070090:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782224170.070101:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc89a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332985344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224170.070468:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224170.070496:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332985600:0@lo:400:kworker.0 00000100:00100000:1.0:1782224170.070524:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224170.070547:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782224170.070723:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332984960 00000100:00100000:3.0:1782224170.070729:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332984960 00000100:00100000:3.0:1782224170.070767:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1782224170.070776:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea90c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332984960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224170.071279:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332985216:0@lo:400:kworker.0 00000100:00100000:1.0:1782224170.071330:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224170.071500:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea90c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332984960:12345-0@lo:400:kworker.0 Request processed in 724us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224170.071510:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1782224170.071718:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332985472 00000100:00100000:1.0:1782224170.071724:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332985472 00000100:00100000:1.0:1782224170.071778:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332985088 00000100:00100000:1.0:1782224170.071781:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332985088 00000100:00100000:2.0:1782224170.071910:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc89a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332985344:12345-0@lo:400:kworker.0 Request processed in 1809us (2467us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224170.071919:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782224170.071936:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332985600 00000100:00100000:2.0:1782224170.071939:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332985600 00000100:00100000:2.0:1782224170.071968:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782224170.071976:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332985600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224170.072037:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332985600:12345-0@lo:400:kworker.0 Request processed in 62us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224170.072044:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782224170.072090:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332984960:0@lo:400:kworker.0 00010000:00080000:2.0:1782224170.072108:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc88d180 x1868797332985344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224170.072120:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332985344:0@lo:400:kworker.0 00000100:00100000:1.0:1782224170.072505:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332985216 00000100:00100000:1.0:1782224170.072510:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332985216 00000100:00100000:1.0:1782224170.072531:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782224170.072538:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332985472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224170.072585:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332985472:12345-0@lo:400:kworker.0 Request processed in 48us (2629us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224170.072604:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782224170.072619:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782224170.072625:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332985088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224170.072666:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332985088:12345-0@lo:400:kworker.0 Request processed in 42us (2198us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224170.072673:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782224170.072685:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782224170.072691:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332985216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224170.072716:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332985216:12345-0@lo:400:kworker.0 Request processed in 26us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224170.072722:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782224170.072770:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332985472:0@lo:400:kworker.0 00000100:00080000:3.0:1782224170.073280:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782224170.073287:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224170.073592:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332985216:0@lo:400:kworker.0 00000100:00100000:1.0:1782224170.073606:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332985088:0@lo:400:kworker.0 00010000:00080000:1.0:1782224170.073620:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc88d500 x1868797332985600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224170.073641:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332985600:0@lo:400:kworker.0 00000100:00100000:0.0:1782224170.587176:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332985728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782224170.587276:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224170.587449:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332985728 00000100:00100000:2.0:1782224170.587460:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332985728 00000100:00100000:2.0:1782224170.587523:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782224170.587551:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332985728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782224170.587596:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224170.591424:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332985728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3859us (4131us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224170.591441:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1782224170.592125:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc88d500 x1868797332985728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224170.592272:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332985728:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782224170.709350:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224171.543405:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224171.543458:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224171.543487:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224171.543686:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311983104 00000100:00100000:2.0:1782224171.543699:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311983104 00000100:00100000:2.0:1782224171.543782:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 41 00000100:00100000:3.0:1782224171.543784:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224171.543799:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797311983104:12345-192.168.202.7@tcp:400:kworker.0 00000100:00080000:3.0:1782224171.543813:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224171.543906:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797311983104:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 112us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224171.543914:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 41 00000100:00100000:2.0:1782224171.543941:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311983232 00000100:00100000:2.0:1782224171.543944:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311983232 00000100:00100000:2.0:1782224171.543972:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311983360 00000100:00100000:2.0:1782224171.543974:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311983360 00000100:00100000:2.0:1782224171.543998:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:2.0:1782224171.544005:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2345:x1868797311983232:12345-192.168.202.7@tcp:9:kworker.0 00000020:00000080:2.0:1782224171.544060:0:6582:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b1648bd 00000100:00080000:2.0:1782224171.544072:0:6582:0:(import.c:65:import_set_state_nolock()) ffff96eaa4806800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1782224171.544093:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782224171.544097:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:2.0:1782224171.544119:0:6582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1782224171.544498:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+2:2345:x1868797311983232:12345-192.168.202.7@tcp:9:kworker.0 Request processed in 492us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224171.544506:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:2.0:1782224171.544521:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:2.0:1782224171.544529:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2345:x1868797311983360:12345-192.168.202.7@tcp:9:kworker.0 00000020:00000080:2.0:1782224171.544555:0:6582:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b1648c4 00000100:00080000:2.0:1782224171.544562:0:6582:0:(import.c:65:import_set_state_nolock()) ffff96eaa4807800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782224171.544586:0:6582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1782224171.544821:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+2:2345:x1868797311983360:12345-192.168.202.7@tcp:9:kworker.0 Request processed in 292us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224171.544828:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00010000:00010000:2.0:1782224171.544925:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224171.544937:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224171.546080:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311982976 00000100:00100000:1.0:1782224171.546091:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311982976 00000100:00100000:1.0:1782224171.546149:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 196 00000100:00100000:1.0:1782224171.546161:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2347:x1868797311982976:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224171.546232:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2347:x1868797311982976:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 72us (2840us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224171.546253:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 196 00000001:00100000:2.0:1782224171.655963:0:7486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 00000020:00000080:2.0:1782224171.655976:0:7486:0:(genops.c:906:class_export_put()) final put ffff96eaa4802000/3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 00000020:00000080:2.0:1782224171.656011:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96eaa4802000/3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 for lustre-OST0001 00000020:00000080:2.0:1782224171.656084:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96eaa4807800 for lustre-OST0001 00010000:00010000:2.0:1782224171.732305:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224172.757222:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782224173.013878:0:8894:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing yml_node 00010000:00010000:2.0:1782224173.785147:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224174.164530:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782224174.164570:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332985856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782224174.164699:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224174.164790:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332985856 00000100:00100000:3.0:1782224174.164800:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332985856 00000100:00100000:3.0:1782224174.164870:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782224174.164882:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332985856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782224174.164941:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224174.164995:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332985856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224174.165004:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1782224174.165053:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782224174.165094:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e9879d7480 x1868797332985856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224174.165118:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332985856:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782224174.804170:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224175.188609:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332986368:0@lo:400:kworker.0 00000100:00100000:2.0:1782224175.188723:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224175.188807:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782224175.188814:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332985984:0@lo:400:kworker.0 00000100:00100000:2.0:1782224175.188849:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224175.188875:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332986496:0@lo:400:kworker.0 00000100:00100000:2.0:1782224175.188905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224175.188944:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332985984 00000100:00100000:2.0:1782224175.188954:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332985984 00000100:00100000:2.0:1782224175.189046:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1782224175.189058:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332985984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224175.189145:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332985984:12345-0@lo:400:kworker.0 Request processed in 88us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224175.189154:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1782224175.189198:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332986496 00000100:00100000:2.0:1782224175.189205:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332986496 00000100:00100000:2.0:1782224175.189259:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782224175.189266:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332986496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224175.189301:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332986496:12345-0@lo:400:kworker.0 Request processed in 36us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224175.189308:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782224175.189349:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332985984:0@lo:400:kworker.0 00000100:00100000:2.0:1782224175.189364:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332986496:0@lo:400:kworker.0 00000100:00100000:3.0:1782224175.189629:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332986368 00000100:00100000:3.0:1782224175.189635:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332986368 00000100:00100000:1.0:1782224175.189683:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332986112:0@lo:400:kworker.0 00000100:00100000:1.0:1782224175.189723:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224175.189759:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332986624:0@lo:400:kworker.0 00000100:00100000:3.0:1782224175.189761:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782224175.189769:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332986368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224175.189782:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224175.189800:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782224175.189806:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332986240:0@lo:400:kworker.0 00000100:00100000:3.0:1782224175.189811:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332986368:12345-0@lo:400:kworker.0 Request processed in 44us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224175.189817:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782224175.189826:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224175.189830:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332986624 00000100:00100000:3.0:1782224175.189833:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332986624 00000100:00100000:1.0:1782224175.189849:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332986112 00000100:00100000:3.0:1782224175.189852:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782224175.189852:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332986112 00000100:00100000:3.0:1782224175.189857:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332986624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224175.189874:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332986240 00000100:00100000:1.0:1782224175.189877:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332986240 00000100:00100000:3.0:1782224175.189891:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332986624:12345-0@lo:400:kworker.0 Request processed in 34us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224175.189893:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782224175.189897:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782224175.189898:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332986112:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782224175.189925:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782224175.189927:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332986112:12345-0@lo:400:kworker.0 Request processed in 28us (203us total) trans 0 rc 0/0 00000100:00080000:3.0:1782224175.189931:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224175.189932:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782224175.189944:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782224175.189949:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332986240:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1782224175.189954:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e9879d5c00 x1868797332986368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224175.189973:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332986240:12345-0@lo:400:kworker.0 Request processed in 24us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224175.189979:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782224175.189982:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332986368:0@lo:400:kworker.0 00000100:00100000:1.0:1782224175.190003:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332986240:0@lo:400:kworker.0 00000100:00100000:1.0:1782224175.190035:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332986112:0@lo:400:kworker.0 00010000:00080000:1.0:1782224175.190058:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e9879d6d80 x1868797332986624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224175.190067:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332986624:0@lo:400:kworker.0 00000100:00100000:1.0:1782224175.702836:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782224175.702871:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332986752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782224175.702974:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224175.703761:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332986752 00000100:00100000:3.0:1782224175.703773:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332986752 00000100:00100000:3.0:1782224175.703834:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782224175.703846:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332986752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782224175.703898:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224175.703989:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332986752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224175.703998:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1782224175.704190:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc88ea00 x1868797332986752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224175.704212:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332986752:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782224175.828135:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782224175.841779:0:6608:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 00000020:00000080:2.0:1782224175.841793:0:6608:0:(genops.c:906:class_export_put()) final put ffff96eaa4802800/3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 00000020:00000080:3.0:1782224175.841943:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96eaa4802800/3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 for lustre-OST0000 00000020:00000080:3.0:1782224175.842006:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96eaa4806800 for lustre-OST0000 00000100:00100000:3.0:1782224176.657380:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224176.657434:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224176.657550:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311983616 00000100:00100000:1.0:1782224176.657563:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311983616 00000100:00100000:1.0:1782224176.657680:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:1.0:1782224176.657692:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2348:x1868797311983616:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224176.657791:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2348:x1868797311983616:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 102us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224176.657799:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:0.0:1782224176.657935:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311983488 00000100:00100000:0.0:1782224176.657940:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311983488 00000100:00100000:0.0:1782224176.657980:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 198 00000100:00100000:0.0:1782224176.657988:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2348:x1868797311983488:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224176.658048:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2348:x1868797311983488:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 60us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224176.658054:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 198 00000100:00080000:3.0:1782224176.658317:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782224176.852284:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224177.877473:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782224178.470627:0:9087:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.83 00010000:00010000:2.0:1782224178.901727:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224179.284840:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782224179.284879:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332986880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782224179.284979:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224179.285344:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332986880 00000100:00100000:3.0:1782224179.285354:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332986880 00000100:00100000:3.0:1782224179.285435:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782224179.285446:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332986880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782224179.285495:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224179.285570:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332986880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224179.285587:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1782224179.285646:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e9879d4e00 x1868797332986880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224179.285670:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332986880:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782224179.285900:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782224179.924522:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224180.311398:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782224180.311438:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868797332987136:0@lo:400:kworker.0 00000100:00100000:3.0:1782224180.311563:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224180.311653:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332987136 00000100:00100000:3.0:1782224180.311663:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332987136 00000100:00100000:3.0:1782224180.311725:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782224180.311735:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868797332987136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224180.311803:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868797332987136:12345-0@lo:400:kworker.0 Request processed in 69us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224180.311811:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782224180.311869:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868797332987136:0@lo:400:kworker.0 00000100:00100000:3.0:1782224180.311914:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797332987264:0@lo:400:kworker.0 00000100:00100000:3.0:1782224180.311937:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224180.311971:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332987264 00000100:00100000:3.0:1782224180.311974:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332987264 00000100:00100000:3.0:1782224180.312011:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782224180.312063:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797332987264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224180.312098:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797332987264:12345-0@lo:400:kworker.0 Request processed in 38us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224180.312105:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782224180.312155:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797332987264:0@lo:400:kworker.0 00000100:00100000:3.0:1782224180.312195:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782224180.312201:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332987648:0@lo:400:kworker.0 00000100:00100000:3.0:1782224180.312227:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224180.312256:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332987648 00000100:00100000:3.0:1782224180.312260:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332987648 00000100:00100000:3.0:1782224180.312296:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782224180.312303:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332987648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224180.312339:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332987648:12345-0@lo:400:kworker.0 Request processed in 36us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224180.312345:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782224180.312373:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332987008:0@lo:400:kworker.0 00010000:00080000:3.0:1782224180.312374:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e9879d6680 x1868797332987648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224180.312385:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332987648:0@lo:400:kworker.0 00000100:00100000:0.0:1782224180.312426:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782224180.312427:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782224180.312434:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224180.312451:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332987008 00000100:00100000:3.0:1782224180.312454:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332987008 00000100:00100000:0.0:1782224180.312456:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332987520:0@lo:400:kworker.0 00000100:00100000:0.0:1782224180.312479:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224180.312480:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1782224180.312486:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797332987008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224180.312495:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782224180.312500:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332987392:0@lo:400:kworker.0 00000100:00100000:3.0:1782224180.312518:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797332987008:12345-0@lo:400:kworker.0 Request processed in 32us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224180.312520:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224180.312525:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1782224180.312554:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332987008:0@lo:400:kworker.0 00000100:00100000:3.0:1782224180.312566:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332987520 00000100:00100000:3.0:1782224180.312569:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332987520 00000100:00100000:0.0:1782224180.312588:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332987392 00000100:00100000:0.0:1782224180.312591:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332987392 00000100:00100000:3.0:1782224180.312594:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782224180.312599:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332987520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224180.312615:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782224180.312621:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332987392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224180.312640:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332987520:12345-0@lo:400:kworker.0 Request processed in 40us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224180.312647:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782224180.312647:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332987392:12345-0@lo:400:kworker.0 Request processed in 27us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224180.312653:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1782224180.312662:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782224180.312677:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e9879d5f80 x1868797332987392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224180.312687:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332987392:0@lo:400:kworker.0 00000100:00100000:3.0:1782224180.312697:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332987520:0@lo:400:kworker.0 00000100:00100000:2.0:1782224180.824051:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224180.824083:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332987776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782224180.824174:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224180.824251:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332987776 00000100:00100000:2.0:1782224180.824261:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332987776 00000100:00100000:2.0:1782224180.824315:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782224180.824337:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc89aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332987776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782224180.824385:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224180.824446:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc89aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332987776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224180.824479:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1782224180.824548:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc89a300 x1868797332987776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224180.824569:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332987776:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782224180.948380:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782224181.340745:0:9184:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.83 00000100:00100000:3.0:1782224181.777826:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224181.778322:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311983872 00000100:00100000:0.0:1782224181.778335:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311983872 00000100:00100000:0.0:1782224181.778436:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:0.0:1782224181.778450:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2349:x1868797311983872:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224181.778574:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2349:x1868797311983872:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 127us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224181.778583:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00080000:3.0:1782224181.779245:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224181.788336:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224181.788429:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311983744 00000100:00100000:1.0:1782224181.788443:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311983744 00000100:00100000:1.0:1782224181.788530:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 200 00000100:00100000:1.0:1782224181.788543:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2348:x1868797311983744:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224181.788641:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2348:x1868797311983744:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 101us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224181.788650:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 200 00010000:00010000:3.0:1782224181.972429:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224182.997486:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224184.021319:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224184.420617:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782224184.420649:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332987904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782224184.420751:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224184.420906:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332987904 00000100:00100000:3.0:1782224184.420915:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332987904 00000100:00100000:3.0:1782224184.420986:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782224184.420997:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332987904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782224184.421620:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224184.421692:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332987904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 695us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224184.421702:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1782224184.421736:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782224184.421768:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e9879d5f80 x1868797332987904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224184.421804:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332987904:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1782224184.687510:0:9282:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.83 00010000:00010000:2.0:1782224185.044953:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224185.428915:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332988032:0@lo:400:kworker.0 00000100:00100000:3.0:1782224185.429044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224185.429117:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332988544:0@lo:400:kworker.0 00000100:00100000:3.0:1782224185.429148:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224185.429178:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782224185.429184:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332988416:0@lo:400:kworker.0 00000100:00100000:3.0:1782224185.429209:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224185.429386:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332988032 00000100:00100000:0.0:1782224185.429396:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332988032 00000100:00100000:0.0:1782224185.429462:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1782224185.429472:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797332988032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224185.429561:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797332988032:12345-0@lo:400:kworker.0 Request processed in 89us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224185.429569:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1782224185.429625:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332988032:0@lo:400:kworker.0 00000100:00100000:0.0:1782224185.429671:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332988160:0@lo:400:kworker.0 00000100:00100000:0.0:1782224185.429707:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224185.429730:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332988672:0@lo:400:kworker.0 00000100:00100000:0.0:1782224185.429750:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224185.429768:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332988416 00000100:00100000:0.0:1782224185.429769:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224185.429773:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332988416 00000100:00100000:0.0:1782224185.429774:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332988288:0@lo:400:kworker.0 00000100:00100000:0.0:1782224185.429795:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224185.429806:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332988672 00000100:00100000:2.0:1782224185.429809:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332988672 00000100:00100000:0.0:1782224185.429821:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782224185.429828:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332988416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224185.429836:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782224185.429842:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332988672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224185.429865:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332988416:12345-0@lo:400:kworker.0 Request processed in 37us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224185.429871:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782224185.429874:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332988672:12345-0@lo:400:kworker.0 Request processed in 33us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224185.429879:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782224185.429891:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332988544 00000100:00100000:0.0:1782224185.429894:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332988544 00000100:00080000:2.0:1782224185.429895:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782224185.429920:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabba6c700 x1868797332988672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224185.429933:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332988672:0@lo:400:kworker.0 00000100:00100000:3.0:1782224185.429941:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332988160 00000100:00100000:3.0:1782224185.429944:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332988160 00000100:00080000:2.0:1782224185.429947:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782224185.430233:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabba6c000 x1868797332988416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224185.430243:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332988416:0@lo:400:kworker.0 00000100:00100000:0.0:1782224185.436964:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332988288 00000100:00100000:0.0:1782224185.436986:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332988288 00000100:00100000:3.0:1782224185.438633:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782224185.438666:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332988544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224185.438832:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332988544:12345-0@lo:400:kworker.0 Request processed in 184us (9682us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224185.438842:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782224185.438865:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782224185.438872:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332988160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224185.438917:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332988160:12345-0@lo:400:kworker.0 Request processed in 45us (9209us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224185.438923:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782224185.439032:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332988160:0@lo:400:kworker.0 00000100:00100000:0.0:1782224185.439444:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782224185.439454:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332988288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224185.439512:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332988288:12345-0@lo:400:kworker.0 Request processed in 60us (9715us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224185.439539:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1782224185.439560:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782224185.439604:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332988544:0@lo:400:kworker.0 00000100:00100000:3.0:1782224185.443122:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332988288:0@lo:400:kworker.0 00000100:00100000:3.0:1782224185.942801:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332988800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782224185.943537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224185.943646:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332988800 00000100:00100000:3.0:1782224185.943655:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332988800 00000100:00100000:3.0:1782224185.943712:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782224185.943723:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332988800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782224185.943768:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224185.943830:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332988800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224185.943837:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1782224185.943888:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e9879d7100 x1868797332988800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224185.943910:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332988800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782224186.068396:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782224186.795494:0:9331:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Jun 23 10:16:24 EDT 2026 00000100:00100000:1.0:1782224186.898286:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224186.898361:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224186.898404:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311984128 00000100:00100000:1.0:1782224186.898417:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311984128 00000100:00100000:1.0:1782224186.898505:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:1.0:1782224186.898518:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797311984128:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224186.898617:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797311984128:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 103us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224186.898626:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:2.0:1782224186.898727:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311984000 00000100:00100000:2.0:1782224186.898732:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311984000 00000100:00100000:2.0:1782224186.898767:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 202 00000100:00100000:2.0:1782224186.898776:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2347:x1868797311984000:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224186.898806:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2347:x1868797311984000:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 32us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224186.898820:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 202 00000100:00080000:1.0:1782224186.901357:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782224187.102998:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224188.120512:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224189.140304:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224189.524300:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782224189.524330:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332988928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782224189.524425:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224189.524583:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332988928 00000100:00100000:3.0:1782224189.524593:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332988928 00000100:00100000:3.0:1782224189.524673:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782224189.524684:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332988928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782224189.524731:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224189.524789:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332988928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224189.524797:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1782224189.524858:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782224189.524897:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e9879d7100 x1868797332988928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224189.524919:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332988928:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782224190.168420:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224190.550626:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332989440:0@lo:400:kworker.0 00000100:00100000:3.0:1782224190.550721:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224190.550813:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782224190.550820:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332989056:0@lo:400:kworker.0 00000100:00100000:3.0:1782224190.550854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224190.550879:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332989568:0@lo:400:kworker.0 00000100:00100000:3.0:1782224190.550922:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224190.550955:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332989184:0@lo:400:kworker.0 00000100:00100000:3.0:1782224190.550982:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224190.551001:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332989696:0@lo:400:kworker.0 00000100:00100000:3.0:1782224190.551053:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224190.551071:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782224190.551077:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332989312:0@lo:400:kworker.0 00000100:00100000:3.0:1782224190.551098:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224190.551137:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332989440 00000100:00100000:3.0:1782224190.551146:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332989440 00000100:00100000:3.0:1782224190.551194:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332989696 00000100:00100000:3.0:1782224190.551197:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332989696 00000100:00100000:3.0:1782224190.551231:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782224190.551240:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332989440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224190.551301:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332989440:12345-0@lo:400:kworker.0 Request processed in 62us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224190.551309:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782224190.551328:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782224190.551335:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332989696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224190.551367:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332989696:12345-0@lo:400:kworker.0 Request processed in 33us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224190.551374:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782224190.551401:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332989056 00000100:00100000:3.0:1782224190.551405:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332989056 00000100:00100000:3.0:1782224190.551430:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1782224190.551451:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332989056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224190.551484:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332989056:12345-0@lo:400:kworker.0 Request processed in 48us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224190.551490:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1782224190.551520:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332989568 00000100:00100000:3.0:1782224190.551523:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332989568 00000100:00100000:3.0:1782224190.551554:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332989184 00000100:00100000:3.0:1782224190.551556:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332989184 00000100:00100000:3.0:1782224190.551566:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332989312 00000100:00100000:3.0:1782224190.551568:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332989312 00000100:00100000:3.0:1782224190.551582:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782224190.551588:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332989568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224190.551618:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332989568:12345-0@lo:400:kworker.0 Request processed in 30us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224190.551623:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782224190.551634:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782224190.551640:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332989184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224190.551663:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332989184:12345-0@lo:400:kworker.0 Request processed in 23us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224190.551668:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782224190.551678:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782224190.551683:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332989312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224190.551707:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332989312:12345-0@lo:400:kworker.0 Request processed in 25us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224190.551721:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1782224190.551750:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782224190.551755:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782224190.551797:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332989312:0@lo:400:kworker.0 00000100:00100000:3.0:1782224190.551806:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332989184:0@lo:400:kworker.0 00010000:00080000:3.0:1782224190.551818:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e9879d6a00 x1868797332989696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224190.551830:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332989696:0@lo:400:kworker.0 00000100:00100000:3.0:1782224190.551856:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332989056:0@lo:400:kworker.0 00000100:00100000:3.0:1782224190.551864:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332989568:0@lo:400:kworker.0 00010000:00080000:3.0:1782224190.551873:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e9879d7800 x1868797332989440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224190.551882:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332989440:0@lo:400:kworker.0 00000100:00100000:3.0:1782224191.061983:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332989824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782224191.062546:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224191.062964:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332989824 00000100:00100000:1.0:1782224191.062976:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332989824 00000100:00100000:1.0:1782224191.063052:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782224191.063065:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332989824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782224191.063107:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224191.063169:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332989824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224191.063177:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1782224191.063268:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabba6f480 x1868797332989824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224191.063306:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332989824:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782224191.190405:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224192.013527:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224192.013594:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224192.013709:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311984384 00000100:00100000:3.0:1782224192.013724:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311984384 00000100:00080000:2.0:1782224192.013852:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782224192.013932:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311984256 00000100:00100000:0.0:1782224192.013942:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311984256 00000100:00100000:0.0:1782224192.014077:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 204 00000100:00100000:0.0:1782224192.014175:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2346:x1868797311984256:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224192.014658:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 57 00000100:00100000:3.0:1782224192.014676:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2346:x1868797311984384:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224192.014759:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2346:x1868797311984384:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 89us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224192.014785:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 57 00000100:00100000:0.0:1782224192.015420:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2346:x1868797311984256:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 1246us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224192.015442:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 204 00010000:00010000:3.0:1782224192.212316:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224193.242432:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224194.261396:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224194.648763:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332989952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782224194.648837:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224194.648916:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332989952 00000100:00100000:1.0:1782224194.648925:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332989952 00000100:00100000:1.0:1782224194.654977:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782224194.654998:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332989952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782224194.655061:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224194.655161:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332989952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (6323us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224194.655170:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1782224194.655196:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782224194.655244:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc88ea00 x1868797332989952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224194.655267:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332989952:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782224195.284938:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224195.669903:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797332990336:0@lo:400:kworker.0 00000100:00100000:2.0:1782224195.669981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224195.670000:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332990464:0@lo:400:kworker.0 00000100:00100000:0.0:1782224195.670055:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224195.670088:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332990208:0@lo:400:kworker.0 00000100:00100000:0.0:1782224195.670112:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224195.670141:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332990464 00000100:00100000:0.0:1782224195.670148:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332990464 00000100:00100000:0.0:1782224195.670198:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782224195.670207:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332990464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224195.670258:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332990464:12345-0@lo:400:kworker.0 Request processed in 51us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224195.670265:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782224195.670491:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332990336 00000100:00100000:2.0:1782224195.670496:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332990336 00000100:00100000:2.0:1782224195.670533:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332990208 00000100:00100000:2.0:1782224195.670536:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332990208 00000100:00100000:2.0:1782224195.670555:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782224195.670562:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc89ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797332990336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224195.670822:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332990080:0@lo:400:kworker.0 00000100:00100000:3.0:1782224195.670860:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224195.670890:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332990080 00000100:00100000:3.0:1782224195.670894:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332990080 00000100:00100000:3.0:1782224195.670998:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1782224195.671006:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797332990080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224195.671060:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797332990080:12345-0@lo:400:kworker.0 Request processed in 55us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224195.671067:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1782224195.671173:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc89ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797332990336:12345-0@lo:400:kworker.0 Request processed in 611us (1191us total) trans 0 rc 0/0 00010000:00080000:0.0:1782224195.671174:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabba6f100 x1868797332990464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224195.671181:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782224195.671195:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782224195.671196:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332990464:0@lo:400:kworker.0 00000100:00100000:2.0:1782224195.671202:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332990208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224195.671226:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332990720:0@lo:400:kworker.0 00000100:00100000:2.0:1782224195.671230:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332990208:12345-0@lo:400:kworker.0 Request processed in 29us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224195.671235:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782224195.671249:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782224195.671256:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782224195.671281:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332990208:0@lo:400:kworker.0 00000100:00100000:3.0:1782224195.671333:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797332990336:0@lo:400:kworker.0 00000100:00100000:0.0:1782224195.671518:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332990720 00000100:00100000:0.0:1782224195.671522:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332990720 00000100:00100000:0.0:1782224195.671568:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782224195.671575:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332990720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224195.671614:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332990720:12345-0@lo:400:kworker.0 Request processed in 40us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224195.671620:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782224195.671646:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332990080:0@lo:400:kworker.0 00000100:00100000:0.0:1782224195.671653:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332990592:0@lo:400:kworker.0 00000100:00100000:0.0:1782224195.671676:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224195.671694:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332990592 00000100:00100000:3.0:1782224195.671698:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332990592 00000100:00100000:3.0:1782224195.671721:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782224195.671727:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332990592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224195.671758:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332990592:12345-0@lo:400:kworker.0 Request processed in 32us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224195.671764:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1782224195.671806:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782224195.671810:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782224195.672532:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabba6c700 x1868797332990720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224195.672547:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332990720:0@lo:400:kworker.0 00000100:00100000:0.0:1782224195.672821:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332990592:0@lo:400:kworker.0 00000100:00100000:0.0:1782224196.183972:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782224196.184004:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332990848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782224196.184120:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224196.184170:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332990848 00000100:00100000:1.0:1782224196.184180:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332990848 00000100:00100000:1.0:1782224196.184246:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782224196.184258:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332990848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782224196.184305:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224196.184363:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332990848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224196.184371:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1782224196.184524:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabba6c000 x1868797332990848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224196.184554:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332990848:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782224196.308426:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224197.145613:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224197.145661:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224197.145691:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311984512 00000100:00100000:3.0:1782224197.145716:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311984512 00000100:00100000:3.0:1782224197.145778:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 206 00000100:00100000:3.0:1782224197.145789:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2347:x1868797311984512:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224197.145907:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2347:x1868797311984512:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 120us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224197.145917:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 206 00000100:00100000:3.0:1782224197.145958:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311984640 00000100:00100000:3.0:1782224197.145961:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311984640 00000100:00100000:3.0:1782224197.146004:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00100000:3.0:1782224197.146011:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797311984640:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224197.146085:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797311984640:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 75us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224197.146092:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00080000:3.0:1782224197.146218:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782224197.338486:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224198.359764:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224199.386240:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224199.765276:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782224199.765309:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332990976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782224199.765418:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224199.765553:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332990976 00000100:00100000:1.0:1782224199.765564:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332990976 00000100:00080000:3.0:1782224199.765696:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782224199.765756:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782224199.765769:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332990976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782224199.765819:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224199.765878:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332990976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224199.765886:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1782224199.765930:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea88af4a80 x1868797332990976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224199.765952:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332990976:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782224200.404806:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224200.797974:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332991488:0@lo:400:kworker.0 00000100:00100000:2.0:1782224200.798079:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224200.798136:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782224200.798150:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332991104:0@lo:400:kworker.0 00000100:00100000:2.0:1782224200.798183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224200.798205:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332991616:0@lo:400:kworker.0 00000100:00100000:2.0:1782224200.798230:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224200.798259:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332991232:0@lo:400:kworker.0 00000100:00100000:2.0:1782224200.798283:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224200.798300:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332991744:0@lo:400:kworker.0 00000100:00100000:2.0:1782224200.798320:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224200.798336:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224200.798353:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332991360:0@lo:400:kworker.0 00000100:00100000:2.0:1782224200.798375:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224200.798411:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332991488 00000100:00100000:2.0:1782224200.798418:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332991488 00000100:00100000:2.0:1782224200.798465:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332991744 00000100:00100000:2.0:1782224200.798468:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332991744 00000100:00100000:2.0:1782224200.798499:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782224200.798507:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332991488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224200.798562:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332991488:12345-0@lo:400:kworker.0 Request processed in 56us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224200.798570:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782224200.798587:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782224200.798593:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332991744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224200.798621:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332991744:12345-0@lo:400:kworker.0 Request processed in 29us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224200.798627:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782224200.798645:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332991104 00000100:00100000:2.0:1782224200.798654:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332991104 00000100:00100000:2.0:1782224200.798702:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1782224200.798709:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332991104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224200.798737:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332991104:12345-0@lo:400:kworker.0 Request processed in 30us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224200.798744:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1782224200.798775:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332991616 00000100:00100000:2.0:1782224200.798778:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332991616 00000100:00100000:2.0:1782224200.798804:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332991232 00000100:00100000:2.0:1782224200.798806:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332991232 00000100:00100000:2.0:1782224200.798818:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332991360 00000100:00100000:2.0:1782224200.798820:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332991360 00000100:00100000:2.0:1782224200.798836:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782224200.798841:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332991616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224200.798870:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332991616:12345-0@lo:400:kworker.0 Request processed in 29us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224200.798876:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782224200.798887:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782224200.798892:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332991232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224200.798916:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332991232:12345-0@lo:400:kworker.0 Request processed in 24us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224200.798921:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782224200.798932:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782224200.798937:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332991360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224200.798960:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332991360:12345-0@lo:400:kworker.0 Request processed in 23us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224200.798965:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1782224200.799007:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782224200.799034:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782224200.799073:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332991360:0@lo:400:kworker.0 00000100:00100000:2.0:1782224200.799085:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332991232:0@lo:400:kworker.0 00010000:00080000:2.0:1782224200.799097:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc553b80 x1868797332991744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224200.799107:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332991744:0@lo:400:kworker.0 00000100:00100000:2.0:1782224200.799141:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332991104:0@lo:400:kworker.0 00000100:00100000:2.0:1782224200.799151:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332991616:0@lo:400:kworker.0 00010000:00080000:2.0:1782224200.799161:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea83f53b80 x1868797332991488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224200.799170:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332991488:0@lo:400:kworker.0 00000100:00100000:0.0:1782224201.300223:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782224201.300254:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332991872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782224201.300361:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224201.300459:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332991872 00000100:00100000:0.0:1782224201.300469:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332991872 00000100:00100000:0.0:1782224201.300533:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782224201.300544:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332991872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782224201.300609:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782224201.300660:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332991872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224201.300668:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1782224201.300731:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabba6c000 x1868797332991872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224201.300754:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332991872:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782224201.428619:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224202.264661:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224202.264712:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224202.264744:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311984768 00000100:00100000:2.0:1782224202.264756:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311984768 00000100:00100000:2.0:1782224202.264811:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 208 00000100:00100000:2.0:1782224202.264820:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83492450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2349:x1868797311984768:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224202.264890:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83492450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2349:x1868797311984768:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 71us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224202.264898:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 208 00000100:00100000:0.0:1782224202.265381:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311984896 00000100:00100000:0.0:1782224202.265387:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311984896 00000100:00100000:0.0:1782224202.265542:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 65 00000100:00100000:0.0:1782224202.265551:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2349:x1868797311984896:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224202.265594:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2349:x1868797311984896:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 45us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224202.265601:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 65 00000100:00080000:2.0:1782224202.265714:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782224202.454117:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224203.476200:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224204.502434:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224204.890630:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332992000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782224204.890745:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224204.890875:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332992000 00000100:00100000:0.0:1782224204.890884:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332992000 00000100:00100000:0.0:1782224204.890965:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782224204.890977:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332992000:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782224204.891356:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1782224204.891427:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782224204.891504:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332992000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 529us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224204.891512:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1782224204.891601:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc551c00 x1868797332992000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224204.891637:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332992000:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782224205.524390:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782224205.727404:0:9961:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:16:43 (1782224203) === 00000100:00100000:0.0:1782224205.910714:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332992128:0@lo:400:kworker.0 00000100:00100000:0.0:1782224205.910846:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224205.910921:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332992640:0@lo:400:kworker.0 00000100:00100000:0.0:1782224205.910944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224205.910968:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782224205.910972:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332992512:0@lo:400:kworker.0 00000100:00100000:0.0:1782224205.910991:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224205.911047:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86106a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332992256:0@lo:400:kworker.0 00000100:00100000:0.0:1782224205.911073:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224205.911092:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332992768:0@lo:400:kworker.0 00000100:00100000:0.0:1782224205.911112:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224205.911131:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782224205.911136:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332992384:0@lo:400:kworker.0 00000100:00100000:0.0:1782224205.911156:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224205.911192:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332992128 00000100:00100000:0.0:1782224205.911201:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332992128 00000100:00100000:0.0:1782224205.911259:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1782224205.911277:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797332992128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224205.911361:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797332992128:12345-0@lo:400:kworker.0 Request processed in 85us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224205.911370:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1782224205.911416:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332992640 00000100:00100000:0.0:1782224205.911420:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332992640 00000100:00100000:0.0:1782224205.911455:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332992256 00000100:00100000:0.0:1782224205.911458:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332992256 00000100:00100000:0.0:1782224205.911468:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332992384 00000100:00100000:0.0:1782224205.911470:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332992384 00000100:00100000:0.0:1782224205.911483:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782224205.911488:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332992640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224205.911522:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332992640:12345-0@lo:400:kworker.0 Request processed in 34us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224205.911529:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782224205.911539:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782224205.911544:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332992256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224205.911575:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332992256:12345-0@lo:400:kworker.0 Request processed in 30us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224205.911581:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782224205.911592:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782224205.911597:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332992384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224205.911624:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332992384:12345-0@lo:400:kworker.0 Request processed in 27us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224205.911630:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782224205.911648:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332992512 00000100:00100000:0.0:1782224205.911651:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332992512 00000100:00100000:0.0:1782224205.911683:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332992768 00000100:00100000:0.0:1782224205.911686:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332992768 00000100:00100000:0.0:1782224205.911705:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782224205.911712:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332992512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224205.911744:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332992512:12345-0@lo:400:kworker.0 Request processed in 33us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224205.911750:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782224205.911759:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782224205.911765:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86104a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332992768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224205.911791:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86104a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332992768:12345-0@lo:400:kworker.0 Request processed in 26us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224205.911796:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1782224205.911835:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782224205.911840:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782224205.911887:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332992384:0@lo:400:kworker.0 00000100:00100000:0.0:1782224205.911898:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86106a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332992256:0@lo:400:kworker.0 00010000:00080000:0.0:1782224205.911911:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea86106300 x1868797332992768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224205.911920:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332992768:0@lo:400:kworker.0 00010000:00080000:0.0:1782224205.911956:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea86104e00 x1868797332992512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224205.911965:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332992512:0@lo:400:kworker.0 00000100:00100000:0.0:1782224205.911974:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332992128:0@lo:400:kworker.0 00000100:00100000:0.0:1782224205.911982:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332992640:0@lo:400:kworker.0 00000100:00100000:2.0:1782224206.060634:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224206.061731:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311985024 00000100:00100000:0.0:1782224206.061745:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311985024 00000100:00100000:0.0:1782224206.061822:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 210 00000100:00100000:0.0:1782224206.061833:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+10:8103:x1868797311985024:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782224206.061855:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224206.061876:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbb87800/0xcfd8b3ae4b164988 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a514c0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224206.061910:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbb87800/0xcfd8b3ae4b164988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514c0 expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224206.061922:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbb87800/0xcfd8b3ae4b164988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514c0 expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224206.061933:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbb87800, rc 0) 00000100:00100000:0.0:1782224206.062056:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+11:8103:x1868797311985024:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 182us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224206.062065:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 210 00000100:00100000:2.0:1782224206.070179:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224206.070873:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311985152 00000100:00100000:3.0:1782224206.070887:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311985152 00000100:00100000:3.0:1782224206.070957:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 211 00000100:00100000:3.0:1782224206.070969:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+11:8103:x1868797311985152:12345-192.168.202.7@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782224206.071498:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+11:8103:x1868797311985152:12345-192.168.202.7@tcp:501:mount.lustre.0 Request processed in 529us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224206.071507:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 211 00000100:00100000:3.0:1782224206.080128:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224206.080289:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311985280 00000100:00100000:2.0:1782224206.080310:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311985280 00000100:00100000:2.0:1782224206.080381:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 212 00000100:00100000:2.0:1782224206.080393:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+11:8103:x1868797311985280:12345-192.168.202.7@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782224206.080935:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+11:8103:x1868797311985280:12345-192.168.202.7@tcp:503:mount.lustre.0 Request processed in 543us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224206.080945:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 212 00000100:00100000:2.0:1782224206.089455:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224206.089744:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311985408 00000100:00100000:1.0:1782224206.089757:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311985408 00000100:00100000:1.0:1782224206.089830:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 213 00000100:00100000:1.0:1782224206.089841:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+11:8107:x1868797311985408:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782224206.090640:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+11:8107:x1868797311985408:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 795us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224206.090662:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 213 00000100:00100000:0.0:1782224206.112222:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224206.112377:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311985536 00000100:00100000:3.0:1782224206.112390:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311985536 00000100:00100000:3.0:1782224206.112462:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 214 00000100:00100000:3.0:1782224206.112491:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+11:8107:x1868797311985536:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782224206.112878:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+11:8107:x1868797311985536:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 388us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224206.112886:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 214 00000100:00100000:3.0:1782224206.115811:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224206.115922:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311985664 00000100:00100000:1.0:1782224206.115935:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311985664 00000100:00100000:1.0:1782224206.116008:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 215 00000100:00100000:1.0:1782224206.116062:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+11:8103:x1868797311985664:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782224206.116082:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224206.116113:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea99876e00/0xcfd8b3ae4b16498f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a514ea expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224206.116149:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea99876e00/0xcfd8b3ae4b16498f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514ea expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224206.116162:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea99876e00/0xcfd8b3ae4b16498f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514ea expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224206.116172:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99876e00, rc 0) 00000100:00100000:1.0:1782224206.116235:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+12:8103:x1868797311985664:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 177us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224206.116243:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 215 00000100:00100000:1.0:1782224206.120736:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224206.124552:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311985792 00000100:00100000:2.0:1782224206.124886:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311985792 00000100:00100000:2.0:1782224206.125068:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 216 00000100:00100000:2.0:1782224206.125082:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+12:8103:x1868797311985792:12345-192.168.202.7@tcp:256:mount.lustre.0 20000000:01000000:2.0:1782224206.125117:0:5779:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782224206.125146:0:5779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782224206.125150:0:5779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782224206.125153:0:5779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782224206.125155:0:5779:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1782224206.129671:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+12:8103:x1868797311985792:12345-192.168.202.7@tcp:256:mount.lustre.0 Request processed in 4583us (10110us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224206.129683:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 216 00000100:00100000:3.0:1782224206.132482:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224206.132578:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311985920 00000100:00100000:0.0:1782224206.132589:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311985920 00000100:00100000:0.0:1782224206.132662:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 217 00000100:00100000:0.0:1782224206.132670:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+12:8103:x1868797311985920:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782224206.132691:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224206.132711:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbb87400/0xcfd8b3ae4b164996 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a514f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224206.132740:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbb87400/0xcfd8b3ae4b164996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514f1 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224206.132765:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbb87400/0xcfd8b3ae4b164996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514f1 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224206.132775:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbb87400, rc 0) 00000100:00100000:0.0:1782224206.132885:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:8103:x1868797311985920:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 214us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224206.132892:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 217 00000100:00100000:3.0:1782224206.134759:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224206.134816:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311986048 00000100:00100000:2.0:1782224206.134825:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311986048 00000100:00100000:2.0:1782224206.134885:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 218 00000100:00100000:2.0:1782224206.134894:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:8103:x1868797311986048:12345-192.168.202.7@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782224206.135284:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:8103:x1868797311986048:12345-192.168.202.7@tcp:501:mount.lustre.0 Request processed in 389us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224206.135302:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 218 00000100:00100000:2.0:1782224206.136661:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224206.136899:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311986176 00000100:00100000:0.0:1782224206.136906:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311986176 00000100:00100000:0.0:1782224206.136995:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 219 00000100:00100000:0.0:1782224206.137003:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:8103:x1868797311986176:12345-192.168.202.7@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782224206.137392:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:8103:x1868797311986176:12345-192.168.202.7@tcp:503:mount.lustre.0 Request processed in 389us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224206.137398:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 219 00000100:00100000:3.0:1782224206.139328:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224206.139361:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311986304 00000100:00100000:2.0:1782224206.139370:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311986304 00000100:00100000:2.0:1782224206.139445:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 220 00000100:00100000:2.0:1782224206.139453:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:8110:x1868797311986304:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782224206.139663:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:8110:x1868797311986304:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 209us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224206.139672:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 220 00000100:00100000:2.0:1782224206.142186:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224206.142374:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311986432 00000100:00100000:0.0:1782224206.142383:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311986432 00000100:00100000:0.0:1782224206.142486:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 221 00000100:00100000:0.0:1782224206.142497:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:8110:x1868797311986432:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782224206.144007:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:8110:x1868797311986432:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 1121us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224206.144055:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 221 00000100:00100000:0.0:1782224206.148366:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224206.148417:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224206.148478:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311986944 00000100:00100000:2.0:1782224206.148488:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311986944 00000100:00080000:0.0:1782224206.148594:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224206.148731:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311986560 00000100:00100000:2.0:1782224206.148736:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311986560 00000100:00100000:1.0:1782224206.148747:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:1.0:1782224206.148763:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2348:x1868797311986944:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224206.148967:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2348:x1868797311986944:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 210us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224206.152283:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:1.0:1782224206.152350:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:1.0:1782224206.152381:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2345:x1868797311986560:12345-192.168.202.7@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782224206.152414:0:5787:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from fff0e469-4c8f-4b03-af7c-046a658bf816@192.168.202.7@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:1.0:1782224206.152461:0:5787:0:(genops.c:1406:class_connect()) connect: client fff0e469-4c8f-4b03-af7c-046a658bf816, cookie 0xcfd8b3ae4b16499d 00000004:00100000:1.0:1782224206.152498:0:5787:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1782224206.153004:0:5787:0:(import.c:65:import_set_state_nolock()) ffff96eaa7f75000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782224206.153115:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fff0e469-4c8f-4b03-af7c-046a658bf816+6:2345:x1868797311986560:12345-192.168.202.7@tcp:38:mount.lustre.0 Request processed in 734us (4695us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224206.153124:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:0.0:1782224206.157122:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224206.157222:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224206.157333:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311986816 00000100:00100000:3.0:1782224206.157343:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311986816 00000100:00100000:3.0:1782224206.157491:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311986688 00000100:00100000:3.0:1782224206.157495:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311986688 00000100:00100000:3.0:1782224206.157515:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:3.0:1782224206.157524:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fff0e469-4c8f-4b03-af7c-046a658bf816+7:8103:x1868797311986816:12345-192.168.202.7@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782224206.157570:0:6605:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1782224206.157654:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fff0e469-4c8f-4b03-af7c-046a658bf816+7:8103:x1868797311986816:12345-192.168.202.7@tcp:41:mount.lustre.0 Request processed in 130us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224206.157661:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:3.0:1782224206.157678:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:3.0:1782224206.157685:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fff0e469-4c8f-4b03-af7c-046a658bf816+6:0:x1868797311986688:12345-192.168.202.7@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782224206.157697:0:6605:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1782224206.157720:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fff0e469-4c8f-4b03-af7c-046a658bf816+6:0:x1868797311986688:12345-192.168.202.7@tcp:41:mount.lustre.0 Request processed in 35us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224206.157727:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00080000:0.0:1782224206.159467:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224206.160132:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224206.160202:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311987072 00000100:00100000:1.0:1782224206.160211:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311987072 00000100:00100000:1.0:1782224206.160269:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:1.0:1782224206.160278:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+6:8103:x1868797311987072:12345-192.168.202.7@tcp:40:mount.lustre.0 00000100:00100000:1.0:1782224206.160376:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+6:8103:x1868797311987072:12345-192.168.202.7@tcp:40:mount.lustre.0 Request processed in 98us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224206.160384:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:3.0:1782224206.161925:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224206.161956:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224206.161985:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311987456 00000100:00100000:0.0:1782224206.161994:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311987456 00000100:00100000:3.0:1782224206.162071:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224206.162073:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:0.0:1782224206.162182:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+6:8103:x1868797311987456:12345-192.168.202.7@tcp:33:mount.lustre.0 00000100:00100000:2.0:1782224206.162408:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311987200 00000100:00100000:2.0:1782224206.162417:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311987200 00000100:00100000:2.0:1782224206.162483:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311987328 00000100:00100000:2.0:1782224206.162487:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311987328 00000100:00100000:3.0:1782224206.162519:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:3.0:1782224206.162525:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1868797311987200:12345-192.168.202.7@tcp:8:mount.lustre.0 00000004:00200000:0.0:1782224206.162526:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1782224206.162671:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+6:8103:x1868797311987456:12345-192.168.202.7@tcp:33:mount.lustre.0 Request processed in 589us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224206.162679:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 1 00010000:00080000:3.0:1782224206.162690:0:6585:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from fff0e469-4c8f-4b03-af7c-046a658bf816@192.168.202.7@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:3.0:1782224206.162722:0:6585:0:(genops.c:1406:class_connect()) connect: client fff0e469-4c8f-4b03-af7c-046a658bf816, cookie 0xcfd8b3ae4b1649a4 00002000:00100000:3.0:1782224206.162737:0:6585:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fff0e469-4c8f-4b03-af7c-046a658bf816/ffff96eabfc70800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782224206.162748:0:6585:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:3.0:1782224206.163228:0:6585:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782224206.163256:0:6585:0:(import.c:65:import_set_state_nolock()) ffff96eabfc77800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782224206.163286:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+6:2345:x1868797311987200:12345-192.168.202.7@tcp:8:mount.lustre.0 Request processed in 760us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224206.163304:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:3.0:1782224206.163329:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:3.0:1782224206.163335:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1868797311987328:12345-192.168.202.7@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782224206.163355:0:6585:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from fff0e469-4c8f-4b03-af7c-046a658bf816@192.168.202.7@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:3.0:1782224206.163373:0:6585:0:(genops.c:1406:class_connect()) connect: client fff0e469-4c8f-4b03-af7c-046a658bf816, cookie 0xcfd8b3ae4b1649ab 00002000:00100000:3.0:1782224206.163380:0:6585:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fff0e469-4c8f-4b03-af7c-046a658bf816/ffff96eabfc71000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782224206.163397:0:6585:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1782224206.163503:0:6585:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782224206.163515:0:6585:0:(import.c:65:import_set_state_nolock()) ffff96eabfc73000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782224206.163534:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+6:2345:x1868797311987328:12345-192.168.202.7@tcp:8:mount.lustre.0 Request processed in 198us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224206.171778:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:2.0:1782224206.420228:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332992896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782224206.420360:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224206.421479:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332992896 00000100:00100000:0.0:1782224206.421489:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332992896 00000100:00100000:0.0:1782224206.421538:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782224206.421546:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332992896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782224206.421570:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782224206.421626:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332992896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224206.421633:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1782224206.421678:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea86106d80 x1868797332992896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224206.421698:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332992896:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1782224206.477321:0:6608:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fff0e469-4c8f-4b03-af7c-046a658bf816 00000001:00100000:3.0:1782224206.512814:0:5808:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fff0e469-4c8f-4b03-af7c-046a658bf816 00010000:00010000:1.0:1782224206.548726:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782224207.524744:0:7486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fff0e469-4c8f-4b03-af7c-046a658bf816 00010000:00010000:1.0:1782224207.572703:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224208.604341:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224209.625436:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224210.004519:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782224210.004550:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332993024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782224210.004645:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224210.004814:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332993024 00000100:00100000:1.0:1782224210.004824:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332993024 00000100:00100000:1.0:1782224210.004897:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782224210.004908:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332993024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782224210.004965:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224210.005048:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332993024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224210.005056:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1782224210.005305:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782224210.005445:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc552a00 x1868797332993024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224210.005469:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332993024:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782224210.651848:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224211.028905:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332993280:0@lo:400:kworker.0 00000100:00100000:1.0:1782224211.029003:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224211.029185:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797332993408:0@lo:400:kworker.0 00000100:00100000:0.0:1782224211.029219:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224211.029337:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332993280 00000100:00100000:0.0:1782224211.029361:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332993280 00000100:00100000:0.0:1782224211.029412:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332993408 00000100:00100000:0.0:1782224211.029415:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332993408 00000100:00100000:0.0:1782224211.029448:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782224211.029460:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332993280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224211.029521:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332993280:12345-0@lo:400:kworker.0 Request processed in 62us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224211.029528:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782224211.029547:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782224211.029553:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797332993408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224211.029583:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797332993408:12345-0@lo:400:kworker.0 Request processed in 30us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224211.029589:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782224211.029630:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797332993408:0@lo:400:kworker.0 00000100:00100000:1.0:1782224211.029823:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332993280:0@lo:400:kworker.0 00000100:00100000:1.0:1782224211.029831:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332993792:0@lo:400:kworker.0 00000100:00100000:1.0:1782224211.029862:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224211.030064:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332993536:0@lo:400:kworker.0 00000100:00100000:2.0:1782224211.030117:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224211.030147:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782224211.030153:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332993152:0@lo:400:kworker.0 00000100:00100000:2.0:1782224211.030181:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224211.030203:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332993664:0@lo:400:kworker.0 00000100:00100000:2.0:1782224211.030224:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224211.030273:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332993152 00000100:00100000:2.0:1782224211.030277:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332993152 00000100:00100000:2.0:1782224211.030309:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1782224211.030316:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332993152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224211.030353:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332993152:12345-0@lo:400:kworker.0 Request processed in 37us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224211.030359:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:2.0:1782224211.030388:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224211.030406:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332993152:0@lo:400:kworker.0 00000100:00100000:2.0:1782224211.030423:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332993664 00000100:00100000:2.0:1782224211.030426:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332993664 00000100:00100000:2.0:1782224211.030453:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782224211.030460:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332993664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224211.030492:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332993664:12345-0@lo:400:kworker.0 Request processed in 32us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224211.030498:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1782224211.030513:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224211.030530:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332993664:0@lo:400:kworker.0 00000100:00100000:0.0:1782224211.031080:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332993792 00000100:00100000:0.0:1782224211.031086:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332993792 00000100:00100000:0.0:1782224211.031131:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332993536 00000100:00100000:0.0:1782224211.031135:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332993536 00000100:00100000:0.0:1782224211.031154:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782224211.031162:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332993792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224211.031207:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332993792:12345-0@lo:400:kworker.0 Request processed in 46us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224211.031214:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782224211.031341:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782224211.031350:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332993536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224211.031385:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332993536:12345-0@lo:400:kworker.0 Request processed in 37us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224211.031404:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1782224211.031817:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea88af6a00 x1868797332993792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224211.031832:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332993792:0@lo:400:kworker.0 00000100:00080000:2.0:1782224211.033205:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782224211.033282:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea88af7b80 x1868797332993536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224211.033315:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332993536:0@lo:400:kworker.0 00000100:00100000:3.0:1782224211.470774:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224211.470831:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224211.470868:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224211.470887:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224211.471234:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224211.471284:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311988096 00000100:00100000:3.0:1782224211.471297:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311988096 00000100:00100000:3.0:1782224211.471363:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311987968 00000100:00100000:3.0:1782224211.471366:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311987968 00000100:00100000:3.0:1782224211.471390:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 41 00000100:00100000:3.0:1782224211.471401:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2348:x1868797311988096:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224211.471495:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2348:x1868797311988096:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 95us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224211.471503:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 41 00000100:00100000:3.0:1782224211.471522:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 42 00000100:00100000:3.0:1782224211.471529:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2348:x1868797311987968:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224211.471570:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2348:x1868797311987968:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 42us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224211.471577:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 42 00000100:00100000:3.0:1782224211.471788:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311987840 00000100:00100000:3.0:1782224211.471793:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311987840 00000100:00100000:3.0:1782224211.471826:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311987712 00000100:00100000:3.0:1782224211.471830:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311987712 00000100:00100000:3.0:1782224211.471851:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 73 00000100:00100000:3.0:1782224211.471856:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2348:x1868797311987840:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224211.471887:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2348:x1868797311987840:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 30us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224211.471893:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 73 00000100:00100000:1.0:1782224211.472165:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311987584 00000100:00100000:1.0:1782224211.472171:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311987584 00000100:00100000:1.0:1782224211.472204:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 223 00000100:00100000:1.0:1782224211.472211:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2348:x1868797311987584:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224211.472239:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2348:x1868797311987584:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 30us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224211.472257:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 223 00000100:00080000:1.0:1782224211.472469:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782224211.472475:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782224211.472477:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782224211.472502:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 74 00000100:00100000:1.0:1782224211.472510:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2348:x1868797311987712:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224211.472542:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2348:x1868797311987712:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 34us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224211.472548:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 74 00000100:00100000:0.0:1782224211.540588:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332993920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782224211.540685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224211.540997:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332993920 00000100:00100000:1.0:1782224211.541007:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332993920 00000100:00100000:1.0:1782224211.541109:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782224211.541121:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86107b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332993920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782224211.541166:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224211.541225:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86107b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332993920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224211.541233:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1782224211.541291:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea86107100 x1868797332993920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224211.541312:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332993920:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782224211.670981:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782224212.329951:0:10158:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1782224212.692392:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224213.716179:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224214.740193:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224215.131859:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfc4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332994048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782224215.132008:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224215.132373:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332994048 00000100:00100000:1.0:1782224215.132382:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332994048 00000100:00100000:1.0:1782224215.132449:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782224215.132459:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332994048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782224215.132498:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224215.132547:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332994048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224215.132554:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1782224215.132595:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabfc4c000 x1868797332994048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782224215.133694:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782224215.134065:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfc4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332994048:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782224215.765213:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224216.149073:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332994176:0@lo:400:kworker.0 00000100:00100000:3.0:1782224216.149153:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224216.149234:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332994304:0@lo:400:kworker.0 00000100:00100000:3.0:1782224216.149239:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332994688:0@lo:400:kworker.0 00000100:00100000:0.0:1782224216.149266:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224216.149291:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332994816:0@lo:400:kworker.0 00000100:00100000:3.0:1782224216.149293:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332994304 00000100:00100000:3.0:1782224216.149300:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332994304 00000100:00100000:0.0:1782224216.149314:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224216.149335:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782224216.149341:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332994432:0@lo:400:kworker.0 00000100:00100000:3.0:1782224216.149347:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782224216.149355:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332994304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224216.149360:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224216.149384:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332994816 00000100:00100000:0.0:1782224216.149387:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332994816 00000100:00100000:3.0:1782224216.149406:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332994304:12345-0@lo:400:kworker.0 Request processed in 52us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224216.149422:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782224216.149427:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782224216.149428:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332994816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224216.149443:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332994432 00000100:00100000:3.0:1782224216.149446:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332994432 00000100:00100000:0.0:1782224216.149458:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332994816:12345-0@lo:400:kworker.0 Request processed in 30us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224216.149463:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782224216.149465:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782224216.149468:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332994432:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782224216.149480:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782224216.149484:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782224216.149492:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332994432:12345-0@lo:400:kworker.0 Request processed in 24us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224216.149497:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782224216.149510:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332994432:0@lo:400:kworker.0 00000100:00100000:0.0:1782224216.149521:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332994304:0@lo:400:kworker.0 00010000:00080000:0.0:1782224216.149533:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc550a80 x1868797332994816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224216.149549:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332994816:0@lo:400:kworker.0 00000100:00100000:0.0:1782224216.149577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224216.149647:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782224216.149653:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332994560:0@lo:400:kworker.0 00000100:00100000:0.0:1782224216.149676:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224216.149741:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332994176 00000100:00100000:2.0:1782224216.149745:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332994176 00000100:00100000:2.0:1782224216.149782:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1782224216.149790:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797332994176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224216.149829:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797332994176:12345-0@lo:400:kworker.0 Request processed in 41us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224216.149835:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1782224216.149866:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332994176:0@lo:400:kworker.0 00000100:00100000:0.0:1782224216.154348:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332994688 00000100:00100000:0.0:1782224216.154362:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332994688 00000100:00100000:0.0:1782224216.154439:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1782224216.154449:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332994688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224216.154551:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332994688:12345-0@lo:400:kworker.0 Request processed in 103us (4972us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224216.154558:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1782224216.154584:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332994560 00000100:00100000:0.0:1782224216.154589:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332994560 00000100:00100000:0.0:1782224216.154616:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782224216.154623:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332994560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224216.154658:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332994560:12345-0@lo:400:kworker.0 Request processed in 36us (4981us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224216.154665:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1782224216.154681:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782224216.154798:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc551500 x1868797332994560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224216.154814:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332994560:0@lo:400:kworker.0 00000100:00100000:2.0:1782224216.154831:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332994688:0@lo:400:kworker.0 00000100:00100000:2.0:1782224216.592900:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224216.592951:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224216.592984:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224216.593006:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224216.593065:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224216.593092:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311988352 00000100:00100000:2.0:1782224216.593101:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311988352 00000100:00100000:2.0:1782224216.593158:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311988480 00000100:00100000:2.0:1782224216.593162:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311988480 00000100:00100000:2.0:1782224216.593190:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 78 00000100:00100000:2.0:1782224216.593213:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2346:x1868797311988352:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224216.593313:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2346:x1868797311988352:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 102us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224216.593321:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 78 00000100:00100000:2.0:1782224216.593340:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 79 00000100:00100000:2.0:1782224216.593348:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2347:x1868797311988480:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224216.593373:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2347:x1868797311988480:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 26us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224216.593379:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 79 00000100:00100000:0.0:1782224216.593730:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311988736 00000100:00100000:0.0:1782224216.593736:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311988736 00000100:00100000:0.0:1782224216.593766:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311988608 00000100:00100000:0.0:1782224216.593769:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311988608 00000100:00100000:0.0:1782224216.593796:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:0.0:1782224216.593804:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2347:x1868797311988736:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224216.593850:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2347:x1868797311988736:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 47us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224216.593858:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:0.0:1782224216.593872:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00100000:0.0:1782224216.593878:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2346:x1868797311988608:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224216.593899:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2346:x1868797311988608:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 22us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224216.593905:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00080000:0.0:1782224216.593924:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782224216.593928:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782224216.593931:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224216.595358:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311988224 00000100:00100000:3.0:1782224216.595370:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311988224 00000100:00100000:3.0:1782224216.595537:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 225 00000100:00100000:3.0:1782224216.595548:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2347:x1868797311988224:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224216.595608:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2347:x1868797311988224:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 62us (2655us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224216.595615:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 225 00000100:00100000:0.0:1782224216.661630:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332994944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782224216.661700:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224216.661794:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332994944 00000100:00100000:0.0:1782224216.661802:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332994944 00000100:00100000:0.0:1782224216.661850:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782224216.661859:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86107100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332994944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782224216.661897:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782224216.661939:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86107100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332994944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224216.661947:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1782224216.661985:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea86105c00 x1868797332994944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224216.662002:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332994944:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782224216.792561:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224217.812932:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224218.836383:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224219.860813:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224220.249639:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782224220.249682:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfc4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332995072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782224220.249775:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224220.249948:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332995072 00000100:00100000:3.0:1782224220.250146:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332995072 00000100:00100000:3.0:1782224220.250240:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1782224220.250249:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782224220.250252:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332995072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782224220.250708:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224220.250801:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332995072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 551us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224220.250809:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1782224220.250908:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabfc4ce00 x1868797332995072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224220.250938:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfc4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332995072:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782224220.887127:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224221.268746:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332995584:0@lo:400:kworker.0 00000100:00100000:1.0:1782224221.268838:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224221.268899:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782224221.268905:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332995200:0@lo:400:kworker.0 00000100:00100000:1.0:1782224221.268938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224221.268968:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332995712:0@lo:400:kworker.0 00000100:00100000:1.0:1782224221.268996:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224221.269056:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797332995456:0@lo:400:kworker.0 00000100:00100000:1.0:1782224221.269081:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224221.269101:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782224221.269106:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868797332995328:0@lo:400:kworker.0 00000100:00100000:1.0:1782224221.269129:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224221.269146:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332995840:0@lo:400:kworker.0 00000100:00100000:1.0:1782224221.269183:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224221.269213:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332995712 00000100:00100000:1.0:1782224221.269221:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332995712 00000100:00100000:1.0:1782224221.269279:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332995456 00000100:00100000:1.0:1782224221.269282:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332995456 00000100:00100000:1.0:1782224221.269296:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332995328 00000100:00100000:1.0:1782224221.269298:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332995328 00000100:00100000:1.0:1782224221.269314:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782224221.269322:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332995712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224221.269383:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332995712:12345-0@lo:400:kworker.0 Request processed in 60us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224221.269391:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782224221.269410:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782224221.269416:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797332995456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224221.269446:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797332995456:12345-0@lo:400:kworker.0 Request processed in 30us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224221.269452:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782224221.269463:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782224221.269469:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868797332995328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224221.269501:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868797332995328:12345-0@lo:400:kworker.0 Request processed in 32us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224221.269507:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782224221.269553:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868797332995328:0@lo:400:kworker.0 00000100:00100000:1.0:1782224221.269565:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797332995456:0@lo:400:kworker.0 00000100:00100000:1.0:1782224221.269596:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332995712:0@lo:400:kworker.0 00000100:00100000:0.0:1782224221.270103:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332995584 00000100:00100000:0.0:1782224221.270109:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332995584 00000100:00100000:0.0:1782224221.270136:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332995840 00000100:00100000:0.0:1782224221.270138:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332995840 00000100:00100000:0.0:1782224221.270172:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782224221.270179:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332995584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224221.270237:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332995584:12345-0@lo:400:kworker.0 Request processed in 58us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224221.270243:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782224221.270255:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782224221.270261:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332995840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224221.270297:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332995840:12345-0@lo:400:kworker.0 Request processed in 37us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224221.270303:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782224221.270322:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332995200 00000100:00100000:0.0:1782224221.270325:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332995200 00010000:00080000:3.0:1782224221.270331:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea88af7800 x1868797332995840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224221.270348:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1782224221.270354:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332995840:0@lo:400:kworker.0 00000100:00100000:0.0:1782224221.270354:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332995200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224221.270383:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332995200:12345-0@lo:400:kworker.0 Request processed in 28us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224221.270389:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:0.0:1782224221.270418:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782224221.270424:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782224221.270445:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332995200:0@lo:400:kworker.0 00010000:00080000:0.0:1782224221.270454:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea88af4380 x1868797332995584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224221.270467:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332995584:0@lo:400:kworker.0 00000100:00100000:3.0:1782224221.732777:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224221.732827:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224221.732854:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224221.732873:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224221.732897:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224221.732930:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311988864 00000100:00100000:3.0:1782224221.732944:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311988864 00000100:00100000:3.0:1782224221.733044:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 227 00000100:00100000:3.0:1782224221.733057:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2346:x1868797311988864:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224221.733165:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2346:x1868797311988864:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 110us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224221.733173:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 227 00000100:00100000:3.0:1782224221.733337:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311989120 00000100:00100000:3.0:1782224221.733342:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311989120 00000100:00100000:3.0:1782224221.733383:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311988992 00000100:00100000:3.0:1782224221.733386:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311988992 00000100:00100000:3.0:1782224221.733406:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 83 00000100:00100000:3.0:1782224221.733414:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2346:x1868797311989120:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224221.733450:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2346:x1868797311989120:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 38us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224221.733457:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 83 00000100:00100000:3.0:1782224221.733469:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 84 00000100:00100000:3.0:1782224221.733475:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2346:x1868797311988992:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224221.733500:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2346:x1868797311988992:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 26us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224221.733518:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 84 00000100:00100000:3.0:1782224221.733538:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311989376 00000100:00100000:3.0:1782224221.733542:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311989376 00000100:00100000:3.0:1782224221.733570:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311989248 00000100:00100000:3.0:1782224221.733573:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311989248 00000100:00100000:3.0:1782224221.733593:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:3.0:1782224221.733600:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2346:x1868797311989376:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224221.733626:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2346:x1868797311989376:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 27us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224221.733632:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:3.0:1782224221.733642:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 50 00000100:00100000:3.0:1782224221.733648:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2346:x1868797311989248:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224221.733684:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2346:x1868797311989248:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 36us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224221.733692:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 50 00000100:00080000:3.0:1782224221.733848:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782224221.733853:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782224221.733857:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224221.783004:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224221.783058:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332995968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782224221.783158:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224221.783192:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332995968 00000100:00100000:3.0:1782224221.783202:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332995968 00000100:00100000:3.0:1782224221.783257:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782224221.783268:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332995968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782224221.783311:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224221.783371:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332995968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224221.783378:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1782224221.783412:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc550a80 x1868797332995968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224221.783431:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332995968:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782224221.914082:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224222.942638:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224223.959317:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224224.980699:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224225.366998:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfc4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332996096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782224225.367135:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224225.367258:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332996096 00000100:00100000:3.0:1782224225.367268:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332996096 00000100:00100000:3.0:1782224225.367347:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782224225.367359:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332996096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782224225.367406:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782224225.367455:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782224225.367466:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332996096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224225.367475:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1782224225.367530:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabfc4ce00 x1868797332996096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224225.367551:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfc4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332996096:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782224226.005186:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224226.389897:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332996608:0@lo:400:kworker.0 00000100:00100000:1.0:1782224226.389973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224226.390071:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782224226.390079:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332996224:0@lo:400:kworker.0 00000100:00100000:1.0:1782224226.390121:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224226.390148:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332996736:0@lo:400:kworker.0 00000100:00100000:1.0:1782224226.390188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224226.390217:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332996352:0@lo:400:kworker.0 00000100:00100000:1.0:1782224226.390244:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224226.390262:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332996864:0@lo:400:kworker.0 00000100:00100000:1.0:1782224226.390313:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224226.390333:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782224226.390339:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332996480:0@lo:400:kworker.0 00000100:00100000:1.0:1782224226.390358:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224226.390398:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332996608 00000100:00100000:1.0:1782224226.390405:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332996608 00000100:00100000:1.0:1782224226.390447:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332996864 00000100:00100000:1.0:1782224226.390450:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332996864 00000100:00100000:1.0:1782224226.390479:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782224226.390489:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332996608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224226.390544:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332996608:12345-0@lo:400:kworker.0 Request processed in 56us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224226.390552:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782224226.390569:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782224226.390575:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332996864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224226.390607:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332996864:12345-0@lo:400:kworker.0 Request processed in 33us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224226.390613:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782224226.390631:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332996224 00000100:00100000:1.0:1782224226.390635:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332996224 00000100:00100000:1.0:1782224226.390658:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1782224226.390665:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332996224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224226.390695:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332996224:12345-0@lo:400:kworker.0 Request processed in 30us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224226.390702:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1782224226.390728:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332996736 00000100:00100000:1.0:1782224226.390731:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332996736 00000100:00100000:1.0:1782224226.390753:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332996352 00000100:00100000:1.0:1782224226.390756:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332996352 00000100:00100000:1.0:1782224226.390765:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332996480 00000100:00100000:1.0:1782224226.390767:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332996480 00000100:00100000:1.0:1782224226.390779:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782224226.390784:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332996736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224226.390817:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797332996736:12345-0@lo:400:kworker.0 Request processed in 33us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224226.390823:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782224226.390834:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782224226.390839:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332996352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224226.390858:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332996352:12345-0@lo:400:kworker.0 Request processed in 19us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224226.390864:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782224226.390872:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782224226.390877:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332996480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224226.390895:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797332996480:12345-0@lo:400:kworker.0 Request processed in 19us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224226.390900:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1782224226.390930:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782224226.390935:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782224226.390963:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332996224:0@lo:400:kworker.0 00000100:00100000:1.0:1782224226.390978:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797332996736:0@lo:400:kworker.0 00010000:00080000:1.0:1782224226.390991:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea88af4380 x1868797332996608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224226.391002:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332996608:0@lo:400:kworker.0 00000100:00100000:1.0:1782224226.391067:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797332996480:0@lo:400:kworker.0 00000100:00100000:1.0:1782224226.391077:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332996352:0@lo:400:kworker.0 00010000:00080000:1.0:1782224226.391086:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea88af7800 x1868797332996864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224226.391116:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332996864:0@lo:400:kworker.0 00000100:00100000:2.0:1782224226.829679:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224226.829846:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311989504 00000100:00100000:0.0:1782224226.829857:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311989504 00000100:00100000:0.0:1782224226.829916:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 229 00000100:00100000:0.0:1782224226.829929:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2347:x1868797311989504:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224226.830037:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2347:x1868797311989504:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 91us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224226.830046:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 229 00000100:00100000:3.0:1782224226.846388:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224226.846728:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224226.847047:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311989760 00000100:00100000:1.0:1782224226.847059:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311989760 00000100:00100000:2.0:1782224226.847074:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311989632 00000100:00100000:2.0:1782224226.847120:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311989632 00000100:00100000:2.0:1782224226.847278:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 88 00000100:00100000:2.0:1782224226.847292:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2346:x1868797311989632:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224226.847414:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2346:x1868797311989632:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 125us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224226.847423:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 88 00000100:00080000:0.0:1782224226.847626:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782224226.847763:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224226.847989:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 89 00000100:00100000:1.0:1782224226.848001:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2347:x1868797311989760:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224226.849087:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2347:x1868797311989760:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 1071us (2691us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224226.849107:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 89 00000100:00100000:3.0:1782224226.849249:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224226.849561:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311989888 00000100:00100000:1.0:1782224226.849569:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311989888 00000100:00080000:2.0:1782224226.849647:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782224226.849648:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:1.0:1782224226.849666:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2345:x1868797311989888:12345-192.168.202.7@tcp:9:kworker.0 00000020:00000080:1.0:1782224226.849706:0:6582:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b1649a4 00000100:00080000:1.0:1782224226.849716:0:6582:0:(import.c:65:import_set_state_nolock()) ffff96eabfc77800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1782224226.849759:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1782224226.849764:0:6582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1782224226.850182:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+2:2345:x1868797311989888:12345-192.168.202.7@tcp:9:kworker.0 Request processed in 518us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224226.850190:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:3.0:1782224226.850821:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224226.851384:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311990016 00000100:00100000:1.0:1782224226.851394:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311990016 00000100:00100000:1.0:1782224226.851462:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:1.0:1782224226.851472:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2345:x1868797311990016:12345-192.168.202.7@tcp:9:kworker.0 00000020:00000080:1.0:1782224226.851500:0:6585:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b1649ab 00000100:00080000:1.0:1782224226.851508:0:6585:0:(import.c:65:import_set_state_nolock()) ffff96eabfc73000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782224226.851546:0:6585:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:2.0:1782224226.851980:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782224226.852625:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+2:2345:x1868797311990016:12345-192.168.202.7@tcp:9:kworker.0 Request processed in 1150us (1802us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224226.852635:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 15 00010000:00010000:0.0:1782224226.852802:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224226.904986:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332996992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782224226.905084:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224226.905190:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332996992 00000100:00100000:2.0:1782224226.905198:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332996992 00000100:00100000:2.0:1782224226.905246:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782224226.905256:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332996992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782224226.905295:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224226.905341:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797332996992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224226.905349:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1782224226.905645:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc550a80 x1868797332996992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224226.905666:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797332996992:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1782224227.006555:0:6608:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fff0e469-4c8f-4b03-af7c-046a658bf816 00000020:00000080:2.0:1782224227.006568:0:6608:0:(genops.c:906:class_export_put()) final put ffff96eabfc70800/fff0e469-4c8f-4b03-af7c-046a658bf816 00000020:00000080:3.0:1782224227.006721:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabfc70800/fff0e469-4c8f-4b03-af7c-046a658bf816 for lustre-OST0000 00000020:00000080:3.0:1782224227.006793:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96eabfc77800 for lustre-OST0000 00010000:00010000:2.0:1782224227.029137:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782224227.999418:0:7486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fff0e469-4c8f-4b03-af7c-046a658bf816 00000020:00000080:2.0:1782224227.999444:0:7486:0:(genops.c:906:class_export_put()) final put ffff96eabfc71000/fff0e469-4c8f-4b03-af7c-046a658bf816 00000020:00000080:0.0:1782224227.999522:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabfc71000/fff0e469-4c8f-4b03-af7c-046a658bf816 for lustre-OST0001 00000020:00000080:0.0:1782224227.999583:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96eabfc73000 for lustre-OST0001 00010000:00010000:0.0:1782224228.057632:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782224228.784236:0:10861:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1782224229.076420:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224230.103725:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224230.484268:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782224230.484295:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332997120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782224230.484371:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224230.484808:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332997120 00000100:00100000:3.0:1782224230.484817:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332997120 00000100:00100000:3.0:1782224230.484882:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782224230.484893:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332997120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782224230.484931:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224230.484981:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797332997120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224230.484988:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1782224230.485206:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782224230.485254:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabd0f9500 x1868797332997120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224230.485274:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797332997120:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782224231.128515:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224231.511462:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332997632:0@lo:400:kworker.0 00000100:00100000:2.0:1782224231.511464:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797332997504:0@lo:400:kworker.0 00000100:00100000:1.0:1782224231.511520:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332997248:0@lo:400:kworker.0 00000100:00100000:2.0:1782224231.517505:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224231.517559:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332997504 00000100:00100000:2.0:1782224231.517579:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332997504 00000100:00100000:2.0:1782224231.517645:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782224231.517656:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797332997504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224231.517715:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797332997504:12345-0@lo:400:kworker.0 Request processed in 61us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224231.517722:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1782224231.517746:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782224231.520446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224231.520592:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332997376:0@lo:400:kworker.0 00000100:00100000:0.0:1782224231.520635:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224231.520658:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332997888:0@lo:400:kworker.0 00000100:00100000:0.0:1782224231.520682:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224231.520719:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332997376 00000100:00100000:0.0:1782224231.520925:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332997376 00000100:00100000:0.0:1782224231.520987:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782224231.520996:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332997376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224231.521093:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797332997376:12345-0@lo:400:kworker.0 Request processed in 99us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224231.521101:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782224231.521143:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797332997376:0@lo:400:kworker.0 00000100:00100000:1.0:1782224231.522112:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332997632 00000100:00100000:1.0:1782224231.522123:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332997632 00000100:00100000:1.0:1782224231.522162:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332997888 00000100:00100000:1.0:1782224231.522166:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332997888 00000100:00100000:1.0:1782224231.522197:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782224231.522206:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86105c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332997632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224231.522279:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86105c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797332997632:12345-0@lo:400:kworker.0 Request processed in 75us (1841us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224231.522286:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782224231.522300:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782224231.522307:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86104a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332997888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224231.522340:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86104a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332997888:12345-0@lo:400:kworker.0 Request processed in 34us (1657us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224231.522347:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1782224231.522376:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782224231.522909:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224231.522938:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332997248 00000100:00100000:1.0:1782224231.522943:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332997248 00010000:00080000:0.0:1782224231.523171:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea83f52a00 x1868797332997888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224231.523186:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332997888:0@lo:400:kworker.0 00010000:00080000:0.0:1782224231.523223:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc552a00 x1868797332997632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224231.523233:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797332997632:0@lo:400:kworker.0 00000100:00100000:1.0:1782224231.524092:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1782224231.524106:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797332997248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224231.524164:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797332997248:12345-0@lo:400:kworker.0 Request processed in 62us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224231.524170:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1782224231.524335:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797332997248:0@lo:400:kworker.0 00000100:00100000:1.0:1782224231.524347:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332997760:0@lo:400:kworker.0 00000100:00100000:1.0:1782224231.524380:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224231.524539:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332997760 00000100:00100000:0.0:1782224231.524546:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332997760 00000100:00100000:0.0:1782224231.524668:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782224231.524675:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332997760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224231.524718:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797332997760:12345-0@lo:400:kworker.0 Request processed in 44us (338us total) trans 0 rc 0/0 00000100:00080000:1.0:1782224231.526426:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782224231.526473:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782224231.526858:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797332997760:0@lo:400:kworker.0 00000100:00100000:2.0:1782224231.529402:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797332997504:0@lo:400:kworker.0 00000100:00100000:3.0:1782224231.950246:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224231.950283:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224231.950406:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311990144 00000100:00100000:2.0:1782224231.950416:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311990144 00000100:00100000:2.0:1782224231.950466:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 231 00000100:00100000:2.0:1782224231.950476:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2349:x1868797311990144:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224231.950666:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2349:x1868797311990144:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 190us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224231.950674:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 231 00000100:00100000:3.0:1782224231.950772:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224231.951731:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311990272 00000100:00100000:1.0:1782224231.951738:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311990272 00000100:00100000:1.0:1782224231.951784:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311990400 00000100:00100000:1.0:1782224231.951786:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311990400 00000100:00100000:1.0:1782224231.951805:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 93 00000100:00100000:1.0:1782224231.951813:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2348:x1868797311990272:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224231.951861:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2348:x1868797311990272:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 49us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224231.951868:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 93 00000100:00100000:1.0:1782224231.951880:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 94 00000100:00100000:1.0:1782224231.951885:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2349:x1868797311990400:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224231.951903:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2349:x1868797311990400:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 18us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224231.951909:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 94 00000100:00080000:1.0:1782224231.951921:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782224232.022822:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782224232.022850:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332998016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782224232.022937:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224232.024402:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332998016 00000100:00100000:3.0:1782224232.024425:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332998016 00000100:00100000:3.0:1782224232.024480:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782224232.024490:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332998016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782224232.024541:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224232.025763:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797332998016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1270us (2821us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224232.025775:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1782224232.025838:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eaa7a0bb80 x1868797332998016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224232.025860:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797332998016:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782224232.152741:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782224232.457873:0:11008:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd6b377d00 20000000:00000080:0.0:1782224232.457901:0:11008:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96eac1d3dc00 uarg=0000000000000000 20000000:01000000:0.0:1782224232.457948:0:11008:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782224232.457955:0:11008:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782224232.457961:0:11008:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1782224232.459358:0:11009:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1782224232.459554:0:11008:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1782224232.466990:0:11008:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782224232.467082:0:11008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224232.467110:0:11008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96eabb610600/0xcfd8b3ae4b164957 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514b9 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224232.467136:0:11008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea90674e00/0xcfd8b3ae4b164965 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16495e expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224232.467144:0:11008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b164973 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16496c expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224232.467152:0:11008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b164981 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b16497a expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224232.467159:0:11008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96eabbb87400/0xcfd8b3ae4b164996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514f1 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224232.467168:0:11008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649b2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224232.467227:0:11008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96eabbb87400/0xcfd8b3ae4b164996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514f1 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224232.467243:0:11008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96eabbb87400/0xcfd8b3ae4b164996 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514f1 expref: 12 pid: 5780 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224232.467261:0:11008:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcbbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11008:1868797332998144:192.168.202.7@tcp:104: 00010000:00010000:1.0:1782224232.467399:0:11008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b164981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b16497a expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224232.467407:0:11008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b164981 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16497a expref: 18 pid: 5780 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224232.467417:0:11008:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcb8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11008:1868797332998272:0@lo:104: 00000100:00100000:1.0:1782224232.467475:0:11008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782224232.467510:0:11008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b164973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b16496c expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224232.467519:0:11008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b164973 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16496c expref: 18 pid: 5781 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224232.467528:0:11008:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcb8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11008:1868797332998400:0@lo:104: 00000100:00100000:1.0:1782224232.467548:0:11008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224232.467597:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332998272 00000100:00100000:1.0:1782224232.467607:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332998272 00000100:00100000:1.0:1782224232.467666:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332998400 00000100:00100000:1.0:1782224232.467670:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332998400 00000100:00100000:1.0:1782224232.467684:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782224232.467693:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+4:11008:x1868797332998272:12345-0@lo:104: 00010000:00010000:1.0:1782224232.467708:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96ea90675c00/0xcfd8b3ae4b16497a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164981 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224232.467759:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782224232.467779:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+4:11008:x1868797332998272:12345-0@lo:104: Request processed in 85us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224232.467787:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782224232.467807:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782224232.467813:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+3:11008:x1868797332998400:12345-0@lo:104: 00010000:00010000:1.0:1782224232.467820:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b16496c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164973 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224232.467850:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782224232.467856:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+3:11008:x1868797332998400:12345-0@lo:104: Request processed in 43us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224232.467868:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1782224232.467899:0:11008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea90674e00/0xcfd8b3ae4b164965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b16495e expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224232.467908:0:11008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96ea90674e00/0xcfd8b3ae4b164965 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16495e expref: 18 pid: 5779 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224232.467917:0:11008:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcb9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11008:1868797332998528:0@lo:104: 00000100:00100000:1.0:1782224232.467940:0:11008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224232.467958:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332998528 00000100:00100000:1.0:1782224232.467961:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332998528 00000100:00100000:1.0:1782224232.467978:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782224232.467984:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+3:11008:x1868797332998528:12345-0@lo:104: 00010000:00010000:1.0:1782224232.467991:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16495e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164965 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224232.468055:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782224232.468061:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b33607d9-62cb-4729-8187-59883763158a+3:11008:x1868797332998528:12345-0@lo:104: Request processed in 77us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224232.468067:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1782224232.468093:0:11008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96eabb610600/0xcfd8b3ae4b164957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514b9 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224232.468101:0:11008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96eabb610600/0xcfd8b3ae4b164957 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514b9 expref: 12 pid: 5780 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224232.468110:0:11008:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcbaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11008:1868797332998656:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224232.468140:0:11008:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea83194480 going to sleep for 11 seconds 00000100:00100000:1.0:1782224232.468175:0:11008:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcb8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11008:1868797332998272:0@lo:104: 00000100:00100000:1.0:1782224232.468185:0:11008:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcb8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11008:1868797332998400:0@lo:104: 00000100:00100000:1.0:1782224232.468192:0:11008:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcb9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11008:1868797332998528:0@lo:104: 00010000:00010000:2.0:1782224232.468319:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782224232.468327:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea90675c00/0xcfd8b3ae4b16497a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164981 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.468335:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675c00 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:2.0:1782224232.468340:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea90675c00/0xcfd8b3ae4b16497a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b164981 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.468349:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea90675c00/0xcfd8b3ae4b16497a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b164981 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782224232.468356:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea90675c00/0xcfd8b3ae4b16497a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b164981 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224232.468362:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782224232.468405:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96ea90675c00/0xcfd8b3ae4b16497a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164981 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.468413:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782224232.468438:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea90675c00/0xcfd8b3ae4b16497a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164981 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.468446:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea90675c00/0xcfd8b3ae4b16497a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164981 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.468465:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782224232.468474:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b16496c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164973 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.468480:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabb610800 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:2.0:1782224232.468483:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b16496c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b164973 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.468490:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b16496c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b164973 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782224232.468496:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b16496c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b164973 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224232.468501:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782224232.468514:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b16496c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164973 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.468519:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782224232.468526:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b16496c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164973 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.468532:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabb610800/0xcfd8b3ae4b16496c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164973 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.468542:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782224232.468545:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16495e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b164965 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.468551:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876c00 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:2.0:1782224232.468554:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16495e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b164965 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.468572:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16495e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b164965 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782224232.468578:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16495e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b164965 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224232.468584:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782224232.468596:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16495e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164965 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.468602:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782224232.468618:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16495e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164965 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.468624:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea99876c00/0xcfd8b3ae4b16495e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b164965 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.468637:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224232.468639:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224232.468641:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224232.468654:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332998784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782224232.468693:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224232.468717:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782224232.468722:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332998912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782224232.468741:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224232.468768:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797332999040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782224232.468789:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224232.468827:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332998784 00000100:00100000:2.0:1782224232.468837:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332998784 00010000:00010000:2.0:1782224232.468861:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b164981 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16497a expref: 19 pid: 5780 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224232.468884:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332998912 00000100:00100000:2.0:1782224232.468886:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332998912 00010000:00010000:2.0:1782224232.468898:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b164973 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16496c expref: 20 pid: 5781 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224232.468909:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332999040 00000100:00100000:2.0:1782224232.468911:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332999040 00010000:00010000:2.0:1782224232.468925:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea90674e00/0xcfd8b3ae4b164965 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16495e expref: 21 pid: 5779 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224232.468936:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782224232.468943:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea860b0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+21:3305:x1868797332998784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782224232.468956:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224232.468962:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b164981 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16497a expref: 21 pid: 5780 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.468971:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b164981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16497a expref: 21 pid: 5780 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.468985:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b164981 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b16497a expref: 21 pid: 5780 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.469002:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224232.469067:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea860b0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+20:3305:x1868797332998784:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224232.469074:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782224232.469124:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782224232.469137:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797332998912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782224232.469146:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224232.469151:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b164973 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16496c expref: 19 pid: 5781 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.469159:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b164973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16496c expref: 19 pid: 5781 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.469170:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b164973 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b16496c expref: 19 pid: 5781 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.469179:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224232.469200:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+18:3305:x1868797332998912:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224232.469205:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782224232.469217:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782224232.469223:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+17:3303:x1868797332999040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782224232.469232:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224232.469236:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea90674e00/0xcfd8b3ae4b164965 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16495e expref: 17 pid: 5779 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.469244:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea90674e00/0xcfd8b3ae4b164965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b16495e expref: 17 pid: 5779 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.469254:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90674e00/0xcfd8b3ae4b164965 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b16495e expref: 17 pid: 5779 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.469262:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224232.469286:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+16:3303:x1868797332999040:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224232.469299:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782224232.469341:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332998912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782224232.469350:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797332998784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782224232.469378:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797332999040:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782224232.471725:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224232.476632:0:11008:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcbbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11008:1868797332998144:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224232.476717:0:11008:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcbaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11008:1868797332998656:192.168.202.7@tcp:104: 00010000:00010000:1.0:1782224232.476757:0:11008:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224232.483007:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224232.483203:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224232.483496:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311990528 00000100:00100000:2.0:1782224232.483508:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311990528 00010000:00010000:2.0:1782224232.483554:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96eabbb87400/0xcfd8b3ae4b164996 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514f1 expref: 13 pid: 5780 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224232.483611:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311990656 00000100:00100000:2.0:1782224232.483615:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311990656 00010000:00010000:2.0:1782224232.483629:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96eabb610600/0xcfd8b3ae4b164957 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514b9 expref: 14 pid: 5780 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224232.483703:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 28 00000100:00100000:2.0:1782224232.483715:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4fff53da-03fa-4566-9f6c-b379e18824a7+14:2346:x1868797311990528:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782224232.483737:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224232.483744:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96eabbb87400/0xcfd8b3ae4b164996 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514f1 expref: 14 pid: 5780 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.483757:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96eabbb87400/0xcfd8b3ae4b164996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514f1 expref: 14 pid: 5780 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.483781:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabbb87400/0xcfd8b3ae4b164996 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514f1 expref: 14 pid: 5780 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.483801:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224232.483881:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2346:x1868797311990528:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 168us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224232.483890:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 28 00000100:00100000:2.0:1782224232.483911:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 29 00000100:00100000:2.0:1782224232.483918:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4fff53da-03fa-4566-9f6c-b379e18824a7+12:2346:x1868797311990656:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782224232.483926:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224232.483929:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96eabb610600/0xcfd8b3ae4b164957 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514b9 expref: 12 pid: 5780 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.483938:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96eabb610600/0xcfd8b3ae4b164957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514b9 expref: 12 pid: 5780 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.483947:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabb610600/0xcfd8b3ae4b164957 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514b9 expref: 12 pid: 5780 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.483960:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649b2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.483969:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649b2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.483987:0:5772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.483995:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.484002:0:5772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649b2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.484009:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.484066:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99877600 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:2.0:1782224232.484071:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.484079:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649b2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.484096:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649b2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224232.484109:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224232.484130:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4fff53da-03fa-4566-9f6c-b379e18824a7+11:2346:x1868797311990656:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 212us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224232.484137:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 29 00010000:00010000:1.0:1782224232.484443:0:11008:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224232.484453:0:11008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224232.484460:0:11008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649b2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224233.172414:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782224233.877245:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782224233.877256:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96eabfbe5800 from 7 10000000:01000000:3.0:1782224233.877263:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782224233.877326:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90674200/0xcfd8b3ae4b1649b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224233.877341:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea90674200/0xcfd8b3ae4b1649b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224233.877356:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea90674200/0xcfd8b3ae4b1649b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224233.877390:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332999168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782224233.877491:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224233.877641:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabf5b5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782224233.877696:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332999168 00000100:00100000:1.0:1782224233.877706:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332999168 00000100:00100000:1.0:1782224233.877765:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1782224233.877775:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+16:5783:x1868797332999168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782224233.877793:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224233.877808:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1649b9 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224233.877838:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1649b9 expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224233.877860:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1649b9 expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224233.877871:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99877600, rc 0) 00000100:00100000:1.0:1782224233.877927:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332999168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224233.877935:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1782224233.878996:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332999168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782224233.879059:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea90674200/0xcfd8b3ae4b1649b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1649c0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224233.879083:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea90674200/0xcfd8b3ae4b1649b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b1649c0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224233.879175:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332999296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224233.879235:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224233.879262:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabf5b5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224233.879655:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332999296 00000100:00100000:2.0:1782224233.879664:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332999296 00000100:00100000:2.0:1782224233.879716:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1782224233.879726:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332999296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782224233.880281:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332999296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 553us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224233.880291:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1782224233.881570:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332999296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224233.881637:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332999424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224233.881714:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224233.881758:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabf5b5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224233.882004:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332999424 00000100:00100000:2.0:1782224233.882011:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332999424 00000100:00100000:2.0:1782224233.882123:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1782224233.882134:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332999424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782224233.882369:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332999424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224233.882385:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1782224233.882788:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332999424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782224233.885303:0:11034:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1782224233.886190:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1782224233.886219:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782224233.886235:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90674200/0xcfd8b3ae4b1649b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1649c0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224233.886250:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea90674200/0xcfd8b3ae4b1649b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1649c0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782224233.886263:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782224233.886267:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96ea8341a800 from 7 10000000:01000000:0.0:1782224233.886271:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782224233.886323:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b1649c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224233.886332:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b1649c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224233.886345:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b1649c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224233.886377:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc550000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332999552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782224233.886470:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224233.886518:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabfca1180 going to sleep for 11 seconds 00000100:00100000:2.0:1782224233.886726:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332999552 00000100:00100000:2.0:1782224233.886735:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332999552 00000100:00100000:2.0:1782224233.886797:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1782224233.886808:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797332999552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782224233.886825:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224233.886839:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbbab800/0xcfd8b3ae4b1649ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1649c7 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224233.886867:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbbab800/0xcfd8b3ae4b1649ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1649c7 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224233.886878:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbbab800/0xcfd8b3ae4b1649ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1649c7 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224233.886888:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab800, rc 0) 00000100:00100000:2.0:1782224233.886940:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332999552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224233.886947:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1782224233.887456:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc550000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332999552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782224233.887477:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b1649c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1649ce expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224233.887487:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b1649c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b1649ce expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224233.888694:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332999680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224233.888771:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224233.888836:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabf5b59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224233.889191:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332999680 00000100:00100000:0.0:1782224233.889201:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332999680 00000100:00100000:0.0:1782224233.889263:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1782224233.889283:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332999680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782224233.890921:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332999680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1630us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224233.890936:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1782224233.891459:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332999680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224233.891536:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332999808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224233.891615:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224233.891658:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabf5b59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224233.893383:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332999808 00000100:00100000:0.0:1782224233.893399:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332999808 00000100:00100000:0.0:1782224233.893474:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1782224233.893487:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332999808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782224233.893774:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332999808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 288us (2157us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224233.893784:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1782224233.894059:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332999808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782224233.894745:0:11035:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1782224233.894806:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1782224233.894831:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782224233.894844:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b1649c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1649ce expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224233.894857:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b1649c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1649ce expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224233.894870:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782224233.894873:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96ea982ae000 from 7 10000000:01000000:1.0:1782224233.894876:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782224233.894916:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1649d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224233.894924:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1649d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224233.894934:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1649d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224233.894974:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcb9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332999936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782224233.895073:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224233.895112:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea99a92e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782224233.896563:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797332999936 00000100:00100000:2.0:1782224233.896580:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797332999936 00000100:00100000:2.0:1782224233.896658:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1782224233.896671:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797332999936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782224233.896692:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224233.896715:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbbab400/0xcfd8b3ae4b1649dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1649d5 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224233.896750:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbbab400/0xcfd8b3ae4b1649dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1649d5 expref: 19 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224233.896779:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbbab400/0xcfd8b3ae4b1649dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1649d5 expref: 19 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224233.896790:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab400, rc 0) 00000100:00100000:2.0:1782224233.896881:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797332999936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (1808us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224233.896889:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1782224233.896962:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcb9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797332999936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782224233.896982:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1649d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1649dc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224233.896992:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1649d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b1649dc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224233.897105:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333000064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782224233.897139:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224233.897170:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07900 going to sleep for 11 seconds 00000100:00100000:2.0:1782224233.897183:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333000064 00000100:00100000:2.0:1782224233.897186:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333000064 00000100:00100000:2.0:1782224233.897204:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1782224233.897210:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797333000064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782224233.897492:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797333000064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224233.897498:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1782224233.897528:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333000064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782224233.897570:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333000192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782224233.897617:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224233.897631:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07900 going to sleep for 11 seconds 00000100:00100000:2.0:1782224233.897642:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333000192 00000100:00100000:2.0:1782224233.897645:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333000192 00000100:00100000:2.0:1782224233.897661:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1782224233.897667:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797333000192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782224233.897829:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797333000192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224233.897836:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1782224233.897869:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333000192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782224233.903724:0:11036:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782224233.903931:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782224233.903957:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782224233.903971:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1649d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1649dc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224233.903986:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1649d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1649dc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224234.062962:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224234.063321:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311990784 00000100:00100000:0.0:1782224234.063335:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311990784 00000100:00100000:0.0:1782224234.063440:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 241 00000100:00100000:0.0:1782224234.063453:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+11:5565:x1868797311990784:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782224234.063476:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224234.063499:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbb87600/0xcfd8b3ae4b1649e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5151b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224234.063539:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbb87600/0xcfd8b3ae4b1649e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5151b expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224234.063564:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbb87600/0xcfd8b3ae4b1649e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5151b expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224234.063575:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbb87600, rc 0) 00000100:00100000:0.0:1782224234.063656:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+12:5565:x1868797311990784:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 Request processed in 206us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224234.063680:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 241 00000100:00100000:3.0:1782224234.067913:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224234.080262:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311990912 00000100:00100000:1.0:1782224234.080285:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311990912 00000100:00100000:1.0:1782224234.080367:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 242 00000100:00100000:1.0:1782224234.080382:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+12:5565:x1868797311990912:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782224234.080901:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+12:5565:x1868797311990912:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 Request processed in 521us (13000us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224234.080911:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 242 00000100:00100000:3.0:1782224234.086282:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224234.086336:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311991040 00000100:00100000:2.0:1782224234.086350:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311991040 00000100:00100000:3.0:1782224234.090754:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 243 00000100:00100000:3.0:1782224234.090772:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+12:5565:x1868797311991040:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224234.091130:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+12:5565:x1868797311991040:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 Request processed in 361us (4862us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224234.091140:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 243 00000100:00100000:3.0:1782224234.098362:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224234.099905:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311991168 00000100:00100000:1.0:1782224234.099924:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311991168 00000100:00100000:1.0:1782224234.100080:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 244 00000100:00100000:1.0:1782224234.100096:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+12:5565:x1868797311991168:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782224234.100121:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224234.100145:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea99876a00/0xcfd8b3ae4b1649ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51522 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224234.100186:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea99876a00/0xcfd8b3ae4b1649ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51522 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224234.100200:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea99876a00/0xcfd8b3ae4b1649ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51522 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224234.100211:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99876a00, rc 0) 00000100:00100000:1.0:1782224234.100332:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:5565:x1868797311991168:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 Request processed in 240us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224234.100341:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 244 00000100:00100000:2.0:1782224234.113469:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224234.114261:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311991296 00000100:00100000:0.0:1782224234.114277:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311991296 00000100:00100000:0.0:1782224234.114353:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 245 00000100:00100000:0.0:1782224234.114365:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:5565:x1868797311991296:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782224234.114821:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:5565:x1868797311991296:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 Request processed in 455us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224234.114830:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 245 00000100:00100000:2.0:1782224234.122430:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224234.122653:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311991424 00000100:00100000:3.0:1782224234.122667:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311991424 00000100:00100000:3.0:1782224234.122739:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 246 00000100:00100000:3.0:1782224234.122751:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:5565:x1868797311991424:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224234.123407:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:5565:x1868797311991424:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 Request processed in 653us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224234.123418:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 246 00010000:00010000:0.0:1782224234.197217:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224235.220915:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224235.605581:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782224235.605614:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333000320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782224235.605713:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224235.606010:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333000320 00000100:00100000:2.0:1782224235.606057:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333000320 00000100:00100000:2.0:1782224235.606133:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782224235.606147:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333000320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782224235.606228:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224235.606286:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333000320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224235.606294:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1782224235.606546:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782224235.606586:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea83f52300 x1868797333000320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224235.606610:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333000320:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782224236.256452:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224236.628412:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333000704:0@lo:400:kworker.0 00000100:00100000:1.0:1782224236.628502:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224236.628693:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797333000576:0@lo:400:kworker.0 00000100:00100000:2.0:1782224236.628780:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797333000448:0@lo:400:kworker.0 00000100:00100000:0.0:1782224236.630740:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224236.630814:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333001088:0@lo:400:kworker.0 00000100:00100000:0.0:1782224236.630854:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224236.630910:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333000832:0@lo:400:kworker.0 00000100:00100000:0.0:1782224236.630933:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224236.631087:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333000704 00000100:00100000:0.0:1782224236.631097:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333000704 00000100:00100000:1.0:1782224236.631722:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782224236.631738:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333000704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224236.631822:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333000704:12345-0@lo:400:kworker.0 Request processed in 89us (3319us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224236.631830:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782224236.631886:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333000704:0@lo:400:kworker.0 00000100:00100000:2.0:1782224236.632028:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224236.632068:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797333000960:0@lo:400:kworker.0 00000100:00100000:2.0:1782224236.632100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224236.632260:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333000448 00000100:00100000:1.0:1782224236.632266:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333000448 00000100:00100000:1.0:1782224236.632353:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1782224236.632361:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797333000448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224236.632408:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797333000448:12345-0@lo:400:kworker.0 Request processed in 48us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224236.632415:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1782224236.634314:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333000576 00000100:00100000:0.0:1782224236.634332:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333000576 00000100:00100000:0.0:1782224236.634410:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333000960 00000100:00100000:0.0:1782224236.634414:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333000960 00000100:00100000:0.0:1782224236.634441:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1782224236.634451:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797333000576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224236.634577:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797333000576:12345-0@lo:400:kworker.0 Request processed in 126us (3842us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224236.634607:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1782224236.634626:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782224236.634632:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797333000960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224236.634664:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797333000960:12345-0@lo:400:kworker.0 Request processed in 32us (2563us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224236.634668:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782224236.634698:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333001088 00000100:00100000:0.0:1782224236.634702:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333001088 00000100:00100000:0.0:1782224236.634731:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333000832 00000100:00100000:0.0:1782224236.634734:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333000832 00000100:00100000:0.0:1782224236.634755:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782224236.634762:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333001088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224236.634797:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333001088:12345-0@lo:400:kworker.0 Request processed in 37us (3943us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224236.634803:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782224236.634814:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782224236.634819:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333000832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224236.634853:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333000832:12345-0@lo:400:kworker.0 Request processed in 33us (3918us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224236.634859:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1782224236.634882:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782224236.634888:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782224236.634939:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabfcb9f80 x1868797333000832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224236.634958:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333000832:0@lo:400:kworker.0 00000100:00100000:0.0:1782224236.635002:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797333000576:0@lo:400:kworker.0 00010000:00080000:0.0:1782224236.635059:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabfcb9180 x1868797333001088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224236.635069:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333001088:0@lo:400:kworker.0 00000100:00100000:2.0:1782224236.636860:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797333000448:0@lo:400:kworker.0 00000100:00100000:2.0:1782224236.636882:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797333000960:0@lo:400:kworker.0 00000100:00100000:3.0:1782224237.072513:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224237.072579:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224237.072605:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224237.072652:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311991552 00000100:00100000:3.0:1782224237.072663:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311991552 00000100:00100000:3.0:1782224237.072738:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 248 00000100:00100000:3.0:1782224237.072749:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2349:x1868797311991552:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224237.072831:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2349:x1868797311991552:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 82us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224237.072839:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 248 00000100:00100000:3.0:1782224237.072872:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311991680 00000100:00100000:3.0:1782224237.072876:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311991680 00000100:00100000:3.0:1782224237.072912:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311991808 00000100:00100000:3.0:1782224237.072915:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311991808 00000100:00100000:3.0:1782224237.072934:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 98 00000100:00100000:3.0:1782224237.072939:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2349:x1868797311991680:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224237.072971:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2349:x1868797311991680:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 32us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224237.072978:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 98 00000100:00100000:3.0:1782224237.072990:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 99 00000100:00100000:3.0:1782224237.072996:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2349:x1868797311991808:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224237.073063:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2349:x1868797311991808:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 67us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224237.073071:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 99 00000100:00080000:3.0:1782224237.073173:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224237.144154:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782224237.144181:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333001216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782224237.144254:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224237.144592:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333001216 00000100:00100000:2.0:1782224237.144601:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333001216 00000100:00100000:2.0:1782224237.144656:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782224237.144666:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333001216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782224237.144704:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224237.144754:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333001216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224237.144762:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1782224237.147690:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eaa7a0a300 x1868797333001216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224237.147753:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333001216:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782224237.271640:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782224237.607662:0:11206:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782224238.295921:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224239.316389:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224240.340284:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224240.724538:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782224240.724573:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333001344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782224240.724672:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224240.724921:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333001344 00000100:00100000:2.0:1782224240.724929:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333001344 00000100:00100000:2.0:1782224240.725048:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782224240.725059:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333001344:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782224240.726439:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1782224240.726943:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224240.733729:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333001344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8661us (9047us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224240.733759:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1782224240.741427:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96ea83f51c00 x1868797333001344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224240.741459:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333001344:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1782224241.314373:0:11306:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:17:19 (1782224239) === 00010000:00010000:2.0:1782224241.376701:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224241.479721:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224241.483518:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311991936 00000100:00100000:2.0:1782224241.483533:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311991936 00000100:00100000:2.0:1782224241.483633:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:2.0:1782224241.483644:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2349:x1868797311991936:12345-192.168.202.7@tcp:41:mkdir.0 00000004:00000024:2.0:1782224241.483694:0:5788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1782224241.483797:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2349:x1868797311991936:12345-192.168.202.7@tcp:41:mkdir.0 Request processed in 154us (4082us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224241.483805:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:3.0:1782224241.484986:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00080000:3.0:1782224241.485090:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224241.486342:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311992064 00000100:00100000:3.0:1782224241.486354:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311992064 00000100:00100000:3.0:1782224241.486405:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:3.0:1782224241.486417:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:9654:x1868797311992064:12345-192.168.202.7@tcp:700:mkdir.0 00000100:00100000:3.0:1782224241.486506:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:9654:x1868797311992064:12345-192.168.202.7@tcp:700:mkdir.0 Request processed in 91us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224241.486513:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:3.0:1782224241.494846:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224241.498268:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311992320 00000100:00100000:2.0:1782224241.498284:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311992320 00000100:00100000:2.0:1782224241.498368:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:2.0:1782224241.498377:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:9654:x1868797311992320:12345-192.168.202.7@tcp:36:mkdir.0 00010000:00010000:2.0:1782224241.498436:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224241.499847:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87e00/0xcfd8b3ae4b1648d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514a4 expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.499891:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96eaa7d65700) 00010000:00010000:2.0:1782224241.499911:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224241.500268:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1649f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.500283:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1649f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.500292:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1649f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.500311:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b1649f8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.500319:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b1649f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.500325:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b1649f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224241.512195:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1782224241.513306:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1649f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.513319:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1649f1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.513326:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1649f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.513332:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbabc00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224241.513337:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1649f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.513346:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1649f1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.513362:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635f000) 00010000:00010000:2.0:1782224241.513365:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224241.513369:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1649f1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.513388:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1649f1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782224241.513407:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000c0b5b24 reply state 00000000e76ddce5 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b1649f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224241.513416:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782224241.513526:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:9654:x1868797311992320:12345-192.168.202.7@tcp:36:mkdir.0 Request processed in 15145us (18684us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1782224241.513536:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 15 00010000:00010000:1.0:1782224241.516465:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b1649f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.516483:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b1649f8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.516491:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b1649f8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.516497:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224241.516501:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b1649f8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.516509:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b1649f8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.517062:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96ea8635fe00) 00010000:00010000:1.0:1782224241.517067:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224241.517072:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b1649f8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.517080:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b1649f8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224241.535754:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224241.536150:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311992448 00000100:00100000:0.0:1782224241.536160:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311992448 00000100:00100000:3.0:1782224241.536297:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:3.0:1782224241.536309:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:9655:x1868797311992448:12345-192.168.202.7@tcp:101:chmod.0 00010000:00010000:3.0:1782224241.536332:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224241.536358:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b1649ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51529 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224241.536421:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b164a06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224241.536447:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b164a06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224241.536461:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b164a06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224241.537350:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1782224241.537357:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1782224241.537397:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b164a06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224241.537427:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b1649ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51529 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224241.537447:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b164a06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51529 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224241.537456:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea87df7300) 00010000:00010000:3.0:1782224241.537459:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782224241.537462:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674a00, rc 0) 00000100:00100000:3.0:1782224241.537838:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:9655:x1868797311992448:12345-192.168.202.7@tcp:101:chmod.0 Request processed in 1530us (2091us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224241.537847:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:1.0:1782224241.551971:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224241.552094:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311992704 00000100:00100000:0.0:1782224241.552105:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311992704 00000100:00100000:0.0:1782224241.552168:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:0.0:1782224241.552179:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:9655:x1868797311992704:12345-192.168.202.7@tcp:36:chmod.0 00010000:00010000:0.0:1782224241.552248:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224241.552274:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b164a06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51529 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.552295:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea87df7300) 00010000:00010000:0.0:1782224241.552305:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782224241.552329:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87200/0xcfd8b3ae4b164a0d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.552342:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87200/0xcfd8b3ae4b164a0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.552351:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87200/0xcfd8b3ae4b164a0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782224241.552928:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002c2e214f reply state 00000000da3abd05 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87200/0xcfd8b3ae4b164a0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224241.552950:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782224241.552977:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1782224241.553183:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:9655:x1868797311992704:12345-192.168.202.7@tcp:36:chmod.0 Request processed in 1005us (1232us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1782224241.553191:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 17 00010000:00010000:2.0:1782224241.555502:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87200/0xcfd8b3ae4b164a0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.555517:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87200/0xcfd8b3ae4b164a0d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.555525:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87200/0xcfd8b3ae4b164a0d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.555530:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224241.555535:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87200/0xcfd8b3ae4b164a0d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.555552:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87200/0xcfd8b3ae4b164a0d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.555569:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96eaa7d65f00) 00010000:00010000:2.0:1782224241.555571:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782224241.555576:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87200/0xcfd8b3ae4b164a0d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.555598:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87200/0xcfd8b3ae4b164a0d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224241.585796:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224241.585907:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311992832 00000100:00100000:0.0:1782224241.585918:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311992832 00000100:00100000:0.0:1782224241.585985:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:0.0:1782224241.585994:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:9656:x1868797311992832:12345-192.168.202.7@tcp:101:chown.0 00010000:00010000:0.0:1782224241.586035:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224241.586058:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87200/0xcfd8b3ae4b164a14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51530 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.586190:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b164a1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.586203:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b164a1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.586274:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b164a1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224241.586339:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1782224241.586343:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782224241.586383:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b164a1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.586410:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87200/0xcfd8b3ae4b164a14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51530 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.586448:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b164a1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51530 expref: 8 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.586457:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96eaa7d65200) 00010000:00010000:0.0:1782224241.586460:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782224241.586463:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbb86e00, rc 0) 00000100:00100000:0.0:1782224241.586528:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:9656:x1868797311992832:12345-192.168.202.7@tcp:101:chown.0 Request processed in 535us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224241.586536:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:0.0:1782224241.594774:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224241.594873:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311992960 00000100:00100000:2.0:1782224241.594883:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311992960 00000100:00100000:2.0:1782224241.594985:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:2.0:1782224241.594997:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:9656:x1868797311992960:12345-192.168.202.7@tcp:101:chown.0 00010000:00010000:2.0:1782224241.595050:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224241.595073:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164a22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51537 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595154:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164a29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595169:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164a29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595180:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164a29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595196:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164a30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595202:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164a30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595208:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164a30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595341:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164a37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595350:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595357:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224241.595407:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1782224241.595412:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224241.595438:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595451:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164a29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595458:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164a29 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595465:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164a29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595471:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaaa00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224241.595475:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164a29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595483:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164a29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595495:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96eaa7d65200) 00010000:00010000:2.0:1782224241.595504:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224241.595509:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164a29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595516:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164a29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595530:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164a30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595537:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164a30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595554:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164a30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595561:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224241.595564:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164a30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595570:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164a30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595579:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96ea8635f000) 00010000:00010000:2.0:1782224241.595581:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224241.595584:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164a30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595590:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164a30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595630:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164a22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51537 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595657:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164a37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51537 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.595664:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96ea8635fc00) 00010000:00010000:2.0:1782224241.595666:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782224241.595669:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab600, rc 0) 00000100:00100000:2.0:1782224241.595736:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:9656:x1868797311992960:12345-192.168.202.7@tcp:101:chown.0 Request processed in 741us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224241.595743:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:3.0:1782224241.598045:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224241.598089:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311993216 00000100:00100000:3.0:1782224241.598097:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311993216 00000100:00100000:3.0:1782224241.598153:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:3.0:1782224241.598165:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:9656:x1868797311993216:12345-192.168.202.7@tcp:36:chown.0 00010000:00010000:3.0:1782224241.598226:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224241.598251:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164a37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51537 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224241.598272:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96ea8635fc00) 00010000:00010000:3.0:1782224241.598285:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782224241.598308:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b164a3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224241.598321:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b164a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224241.598332:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b164a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782224241.656827:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1782224241.656849:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1782224241.656936:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004933d9f6 reply state 000000007ac47df8 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b164a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224241.656951:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782224241.657199:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1782224241.657304:0:6605:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1782224241.657365:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:9656:x1868797311993216:12345-192.168.202.7@tcp:36:chown.0 Request processed in 59198us (59323us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1782224241.657375:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 20 00010000:00010000:1.0:1782224241.657444:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b164a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.657453:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b164a3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.657461:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b164a3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.657467:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224241.657533:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b164a3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.657603:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b164a3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.657919:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96ea87df7b00) 00010000:00010000:1.0:1782224241.657923:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782224241.657928:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b164a3e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.657935:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b164a3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224241.681615:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224241.681683:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311993344 00000100:00100000:0.0:1782224241.681758:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311993344 00000100:00100000:0.0:1782224241.681873:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:0.0:1782224241.681884:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:9657:x1868797311993344:12345-192.168.202.7@tcp:101:touch.500 00010000:00010000:0.0:1782224241.681910:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224241.681940:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87200/0xcfd8b3ae4b164a45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5153e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782224241.682828:0:5786:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 777us 00010000:00010000:0.0:1782224241.706256:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87e00/0xcfd8b3ae4b164a4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.706278:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87e00/0xcfd8b3ae4b164a4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.706355:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87e00/0xcfd8b3ae4b164a4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.706373:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86200/0xcfd8b3ae4b164a53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.706380:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86200/0xcfd8b3ae4b164a53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.706387:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86200/0xcfd8b3ae4b164a53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.707177:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b164a5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.707189:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b164a5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.707197:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b164a5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224241.707346:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782224241.707351:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782224241.707442:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b164a5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.707465:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87e00/0xcfd8b3ae4b164a4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.707472:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87e00/0xcfd8b3ae4b164a4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.708125:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87e00/0xcfd8b3ae4b164a4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.708133:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224241.708137:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87e00/0xcfd8b3ae4b164a4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.708145:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87e00/0xcfd8b3ae4b164a4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.708159:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96eaa7d65200) 00010000:00010000:0.0:1782224241.708162:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224241.708167:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87e00/0xcfd8b3ae4b164a4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.708173:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87e00/0xcfd8b3ae4b164a4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.708186:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86200/0xcfd8b3ae4b164a53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.708192:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86200/0xcfd8b3ae4b164a53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.708198:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86200/0xcfd8b3ae4b164a53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.708212:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224241.708215:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86200/0xcfd8b3ae4b164a53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.708222:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86200/0xcfd8b3ae4b164a53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.708231:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96eaa7d65c00) 00010000:00010000:0.0:1782224241.708234:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224241.708237:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86200/0xcfd8b3ae4b164a53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.708242:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86200/0xcfd8b3ae4b164a53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.708347:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87200/0xcfd8b3ae4b164a45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5153e expref: 8 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.708365:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b164a5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5153e expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.708372:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:0.0:1782224241.708374:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782224241.708376:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbb86600, rc 0) 00000100:00100000:1.0:1782224241.708849:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:9657:x1868797311993344:12345-192.168.202.7@tcp:101:touch.500 Request processed in 26965us (27242us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224241.708860:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:3.0:1782224241.711951:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224241.712061:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311993600 00000100:00100000:1.0:1782224241.712073:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311993600 00000100:00100000:0.0:1782224241.712218:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:0.0:1782224241.712231:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:9657:x1868797311993600:12345-192.168.202.7@tcp:101:touch.500 00010000:00010000:0.0:1782224241.712252:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224241.712272:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86800/0xcfd8b3ae4b164a61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51545 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.712636:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b164a68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.712653:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b164a68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.712730:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b164a68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.714128:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b164a6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.714145:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b164a6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.714155:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b164a6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782224241.715113:0:5788:0:(osp_object.c:1673:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1782224241.715403:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75400/0xcfd8b3ae4b164a76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.715417:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75400/0xcfd8b3ae4b164a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.715429:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75400/0xcfd8b3ae4b164a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.715463:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b164a68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.715481:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b164a68 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.715488:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b164a68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.715495:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86000 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224241.715501:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b164a68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.715509:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b164a68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.715522:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:0.0:1782224241.715525:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224241.715529:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b164a68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.715535:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b164a68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782224241.715548:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bd3afc20 reply state 00000000a0d2673b transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b164a6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224241.715558:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782224241.715599:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86800/0xcfd8b3ae4b164a61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51545 expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.715615:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75400/0xcfd8b3ae4b164a76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51545 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.715633:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:0.0:1782224241.715636:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782224241.715639:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a75400, rc 0) 00000100:00100000:0.0:1782224241.715719:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+10:9657:x1868797311993600:12345-192.168.202.7@tcp:101:touch.500 Request processed in 3491us (3775us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1782224241.715728:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 22 00010000:00010000:1.0:1782224241.718667:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b164a6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.718684:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b164a6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.718706:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b164a6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.718712:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224241.718718:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b164a6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.718726:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b164a6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.718743:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbf4b6a20 (ffff96eaa7d65300) 00010000:00010000:1.0:1782224241.718746:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224241.718751:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b164a6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.718758:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b164a6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224241.720638:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224241.720707:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311993856 00000100:00100000:2.0:1782224241.720718:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311993856 00000100:00100000:2.0:1782224241.720780:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:2.0:1782224241.720790:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:9657:x1868797311993856:12345-192.168.202.7@tcp:36:touch.500 00010000:00010000:2.0:1782224241.720851:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224241.720880:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75400/0xcfd8b3ae4b164a76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51545 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.720900:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:2.0:1782224241.720910:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224241.720977:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164a84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.720990:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164a84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.721000:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164a84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782224241.722423:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d557df68 reply state 00000000cabe6b09 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164a84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224241.722438:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782224241.722554:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+10:9657:x1868797311993856:12345-192.168.202.7@tcp:36:touch.500 Request processed in 1763us (1920us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782224241.722563:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 23 00010000:00010000:2.0:1782224241.725622:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164a84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.725639:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164a84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.725646:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164a84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.725652:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbabc00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224241.725657:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164a84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.725665:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164a84 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.725681:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96ea8635f000) 00010000:00010000:2.0:1782224241.725684:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782224241.725688:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:2.0:1782224241.725688:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164a84 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.725695:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164a84 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224241.725752:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311993984 00000100:00100000:0.0:1782224241.725762:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311993984 00000100:00100000:0.0:1782224241.725818:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00100000:0.0:1782224241.725829:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:9657:x1868797311993984:12345-192.168.202.7@tcp:101:touch.500 00010000:00010000:0.0:1782224241.725853:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224241.725873:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75800/0xcfd8b3ae4b164a8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5154c expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.725926:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75800/0xcfd8b3ae4b164a8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5154c expref: 10 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.725941:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75800/0xcfd8b3ae4b164a8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5154c expref: 10 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.725969:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96eaa7d65c00) 00010000:00010000:0.0:1782224241.725973:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782224241.725975:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a75800, rc 0) 00000100:00100000:0.0:1782224241.726046:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+10:9657:x1868797311993984:12345-192.168.202.7@tcp:101:touch.500 Request processed in 218us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224241.726063:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00100000:3.0:1782224241.729662:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224241.729833:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311994112 00000100:00100000:0.0:1782224241.729844:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311994112 00000100:00100000:0.0:1782224241.729899:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:0.0:1782224241.729907:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1868797311994112:12345-192.168.202.7@tcp:8:touch.500 00010000:00080000:0.0:1782224241.729942:0:6582:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:0.0:1782224241.729984:0:6582:0:(genops.c:1406:class_connect()) connect: client 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39, cookie 0xcfd8b3ae4b164a92 00002000:00100000:0.0:1782224241.729998:0:6582:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39/ffff96eabf83b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782224241.730063:0:6582:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:0.0:1782224241.730428:0:6582:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782224241.730460:0:6582:0:(import.c:65:import_set_state_nolock()) ffff96ea83419800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782224241.730524:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2345:x1868797311994112:12345-192.168.202.7@tcp:8:touch.500 Request processed in 615us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224241.730882:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:3.0:1782224241.735771:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224241.735945:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311994240 00000100:00100000:0.0:1782224241.735963:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311994240 00000100:00100000:0.0:1782224241.736064:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:0.0:1782224241.736075:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:0:x1868797311994240:12345-192.168.202.7@tcp:2:touch.500 00000100:00080000:3.0:1782224241.736560:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782224241.748419:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797333001472:0@lo:400:kworker.0 00000100:00100000:2.0:1782224241.748730:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224241.748777:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797333001984:0@lo:400:kworker.0 00000100:00100000:2.0:1782224241.748824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224241.748855:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782224241.748862:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333001600:0@lo:400:kworker.0 00000100:00100000:2.0:1782224241.748885:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224241.748902:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333002112:0@lo:400:kworker.0 00000100:00100000:2.0:1782224241.750163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224241.750207:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333001728:0@lo:400:kworker.0 00000100:00100000:2.0:1782224241.750239:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224241.750262:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224241.750269:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333001856:0@lo:400:kworker.0 00000100:00100000:2.0:1782224241.750560:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224241.750607:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333001472 00000100:00100000:2.0:1782224241.750615:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333001472 00000100:00100000:2.0:1782224241.750663:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1782224241.750672:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797333001472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224241.750724:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797333001472:12345-0@lo:400:kworker.0 Request processed in 53us (1995us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224241.750732:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1782224241.750763:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333001984 00000100:00100000:2.0:1782224241.750767:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333001984 00000100:00100000:2.0:1782224241.750800:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333001600 00000100:00100000:2.0:1782224241.750803:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333001600 00000100:00100000:2.0:1782224241.750826:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333001728 00000100:00100000:2.0:1782224241.750828:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333001728 00000100:00100000:2.0:1782224241.750844:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1782224241.750850:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797333001984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224241.750883:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797333001984:12345-0@lo:400:kworker.0 Request processed in 33us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224241.750889:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1782224241.750900:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1782224241.750906:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333001600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224241.750947:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333001600:12345-0@lo:400:kworker.0 Request processed in 41us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224241.750953:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1782224241.750995:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782224241.751002:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333001728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224241.751053:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333001728:12345-0@lo:400:kworker.0 Request processed in 52us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224241.751059:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782224241.751081:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333002112 00000100:00100000:2.0:1782224241.751084:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333002112 00000100:00100000:2.0:1782224241.751108:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333001856 00000100:00100000:2.0:1782224241.751111:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333001856 00000100:00100000:2.0:1782224241.751576:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782224241.751593:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333002112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224241.751644:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333002112:12345-0@lo:400:kworker.0 Request processed in 61us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224241.754116:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782224241.754145:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333001856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224241.754228:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333001856:12345-0@lo:400:kworker.0 Request processed in 101us (3668us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224241.754250:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782224241.756893:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1782224241.756964:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782224241.756981:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782224241.757043:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabd0fa680 x1868797333001856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224241.757059:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333001856:0@lo:400:kworker.0 00000100:00100000:2.0:1782224241.757076:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333001728:0@lo:400:kworker.0 00000100:00100000:2.0:1782224241.757125:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333001600:0@lo:400:kworker.0 00010000:00080000:2.0:1782224241.757151:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabd0f9f80 x1868797333002112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224241.757160:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333002112:0@lo:400:kworker.0 00000100:00100000:2.0:1782224241.757170:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797333001472:0@lo:400:kworker.0 00000100:00100000:2.0:1782224241.757181:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797333001984:0@lo:400:kworker.0 00000001:00080000:3.0:1782224241.777832:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1782224241.777849:0:7486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 00000100:00100000:0.0:1782224241.778061:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:0:x1868797311994240:12345-192.168.202.7@tcp:2:touch.500 Request processed in 41983us (42291us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1782224241.778072:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:3.0:1782224241.786062:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224241.787925:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311994496 00000100:00100000:0.0:1782224241.787940:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311994496 00000100:00100000:0.0:1782224241.788062:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:0.0:1782224241.788073:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+10:9657:x1868797311994496:12345-192.168.202.7@tcp:35:touch.500 00000100:00100000:0.0:1782224241.788422:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+11:9657:x1868797311994496:12345-192.168.202.7@tcp:35:touch.500 Request processed in 350us (2406us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1782224241.788431:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:3.0:1782224241.822202:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224241.822274:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311994624 00000100:00100000:2.0:1782224241.822349:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311994624 00000100:00100000:2.0:1782224241.822421:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 25 00000100:00100000:2.0:1782224241.822432:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+11:9658:x1868797311994624:12345-192.168.202.7@tcp:101:rm.0 00010000:00010000:2.0:1782224241.822457:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224241.822478:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164a99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51553 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.822541:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164aa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.822557:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.822585:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224241.822647:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782224241.822651:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224241.822707:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.822733:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164a99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51553 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.822752:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51553 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.822761:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:2.0:1782224241.822763:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782224241.822767:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab200, rc 0) 00000100:00100000:2.0:1782224241.822885:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+12:9658:x1868797311994624:12345-192.168.202.7@tcp:101:rm.0 Request processed in 454us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224241.822893:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 25 00000100:00100000:3.0:1782224241.829936:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224241.830191:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311994880 00000100:00100000:2.0:1782224241.830202:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311994880 00000100:00100000:2.0:1782224241.830325:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 26 00000100:00100000:2.0:1782224241.830336:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+12:9658:x1868797311994880:12345-192.168.202.7@tcp:101:rm.0 00010000:00010000:2.0:1782224241.830356:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224241.830375:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164aa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5155a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224241.830520:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1782224241.830674:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164aa7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5155a expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.830688:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96eaa7d65200) 00010000:00010000:2.0:1782224241.830691:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782224241.830696:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164aa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5155a expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.830710:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbabc00, rc 0) 00000100:00100000:2.0:1782224241.830774:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:9658:x1868797311994880:12345-192.168.202.7@tcp:101:rm.0 Request processed in 439us (846us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1782224241.830782:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 26 00000100:00100000:2.0:1782224241.840479:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224241.840584:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311995008 00000100:00100000:0.0:1782224241.840593:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311995008 00000100:00100000:0.0:1782224241.840671:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:0.0:1782224241.840682:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:9658:x1868797311995008:12345-192.168.202.7@tcp:37:rm.0 00000100:00100000:0.0:1782224241.844853:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:9658:x1868797311995008:12345-192.168.202.7@tcp:37:rm.0 Request processed in 4164us (4374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224241.844867:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:3.0:1782224241.848649:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224241.848759:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311995264 00000100:00100000:2.0:1782224241.848768:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311995264 00000100:00100000:2.0:1782224241.848826:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:2.0:1782224241.848836:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea9c491850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:9658:x1868797311995264:12345-192.168.202.7@tcp:35:rm.0 00000100:00100000:3.0:1782224241.850274:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea9c491850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+14:9658:x1868797311995264:12345-192.168.202.7@tcp:35:rm.0 Request processed in 1431us (1626us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1782224241.850301:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:3.0:1782224241.853847:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224241.854048:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311995520 00000100:00100000:2.0:1782224241.854059:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311995520 00000100:00100000:2.0:1782224241.854111:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:2.0:1782224241.854120:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+14:9658:x1868797311995520:12345-192.168.202.7@tcp:101:rm.0 00010000:00010000:2.0:1782224241.854154:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224241.854172:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164ab5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51561 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.854322:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b164abc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.854337:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b164abc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.854349:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b164abc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224241.854359:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1782224241.854494:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164ab5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51561 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.854513:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b164abc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51561 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.854521:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:2.0:1782224241.854524:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782224241.854528:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaa600, rc 0) 00000100:00100000:2.0:1782224241.854586:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+16:9658:x1868797311995520:12345-192.168.202.7@tcp:101:rm.0 Request processed in 467us (747us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1782224241.854599:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:0.0:1782224241.859906:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224241.860168:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311995648 00000100:00100000:2.0:1782224241.860178:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311995648 00000100:00100000:2.0:1782224241.860233:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 28 00000100:00100000:2.0:1782224241.860243:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+16:9658:x1868797311995648:12345-192.168.202.7@tcp:41:rm.0 00000004:00000024:2.0:1782224241.860318:0:6605:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1782224241.860409:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+16:9658:x1868797311995648:12345-192.168.202.7@tcp:41:rm.0 Request processed in 167us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224241.860417:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 28 00000100:00100000:3.0:1782224241.871245:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224241.871508:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311995776 00000100:00100000:2.0:1782224241.871517:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311995776 00000100:00100000:2.0:1782224241.871565:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 29 00000100:00100000:2.0:1782224241.871574:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+16:9658:x1868797311995776:12345-192.168.202.7@tcp:101:rm.0 00010000:00010000:2.0:1782224241.871593:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224241.871612:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164aca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51568 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.871671:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164ad1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.871686:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164ad1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.871698:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164ad1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.871713:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164ad8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.871720:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.871727:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.871828:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164adf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.871854:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.871862:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224241.871890:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782224241.871895:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224241.871911:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.871922:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.871930:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164ad1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.871936:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164ad1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.871943:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164ad1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.871949:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbabe00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224241.871953:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164ad1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.871971:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164ad1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.871983:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:2.0:1782224241.871986:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224241.871997:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164ad1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.872003:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164ad1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.872038:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.872045:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164ad8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.872050:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.872055:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224241.872058:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.872064:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164ad8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.872072:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbf4b6a20 (ffff96ea8635f200) 00010000:00010000:2.0:1782224241.872075:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224241.872078:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164ad8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.872083:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164ad8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.872113:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164aca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51568 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.872153:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51568 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.872160:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96eaa7d65c00) 00010000:00010000:2.0:1782224241.872162:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782224241.872164:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaa800, rc 0) 00000100:00100000:2.0:1782224241.872223:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+17:9658:x1868797311995776:12345-192.168.202.7@tcp:101:rm.0 Request processed in 650us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224241.872231:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 29 00000100:00100000:3.0:1782224241.885120:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224241.885608:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311996032 00000100:00100000:2.0:1782224241.885619:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311996032 00000100:00100000:2.0:1782224241.885681:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 30 00000100:00100000:2.0:1782224241.885692:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+17:9658:x1868797311996032:12345-192.168.202.7@tcp:36:rm.0 00010000:00010000:2.0:1782224241.885748:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782224241.885774:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164adf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51568 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.885796:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75800/0xcfd8b3ae4b164a8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5154c expref: 16 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.885808:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96eaa7d65c00) 00010000:00010000:2.0:1782224241.885823:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164aa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51553 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.885832:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:2.0:1782224241.885849:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224241.885868:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164ae6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.885881:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164ae6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.885890:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164ae6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.885904:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164aed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.885911:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.885917:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.886109:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164af4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.886118:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164af4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.886135:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164af4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782224241.887646:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1782224241.887660:0:6605:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 322667644262ns, next at 323667641590ns, rc = 0 00010000:00010000:2.0:1782224241.887742:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa000/0xcfd8b3ae4b164afb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887769:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa000/0xcfd8b3ae4b164afb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887779:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa000/0xcfd8b3ae4b164afb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887789:0:6605:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa000/0xcfd8b3ae4b164afb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887795:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa000/0xcfd8b3ae4b164afb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887801:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa000/0xcfd8b3ae4b164afb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887827:0:6605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782224241.887848:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164af4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887855:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164af4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887860:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164af4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887866:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbabe00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224241.887871:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164af4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887878:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164af4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887899:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96ea8635f000) 00010000:00010000:2.0:1782224241.887902:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782224241.887907:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164af4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887912:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164af4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887930:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164ae6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887936:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164ae6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887942:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164ae6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887946:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbabc00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224241.887949:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164ae6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887963:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164ae6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887971:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:2.0:1782224241.887974:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224241.887978:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164ae6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.887983:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164ae6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782224241.888003:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000981d9d3f reply state 00000000923503bf transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224241.888011:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782224241.888137:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+16:9658:x1868797311996032:12345-192.168.202.7@tcp:36:rm.0 Request processed in 2444us (3024us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1782224241.888147:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 30 00010000:00010000:0.0:1782224241.888308:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224241.888315:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa000/0xcfd8b3ae4b164afb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.888323:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa000 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224241.888326:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa000/0xcfd8b3ae4b164afb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.888332:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa000/0xcfd8b3ae4b164afb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.888341:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96ea8635f000) 00010000:00010000:0.0:1782224241.888344:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782224241.888347:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa000/0xcfd8b3ae4b164afb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.888352:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa000/0xcfd8b3ae4b164afb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224241.888375:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224241.888377:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224241.888379:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224241.890979:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.890994:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164aed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.891002:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164aed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.891008:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa200 already unused, calling callback (ffffffffc1ef74f0) 00000100:00100000:3.0:1782224241.892464:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:2.0:1782224241.892777:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164aed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.892795:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164aed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.892813:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbf4b6a20 (ffff96ea8635f200) 00010000:00010000:2.0:1782224241.892816:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224241.892821:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164aed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.892827:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164aed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224241.895425:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311996288 00000100:00100000:0.0:1782224241.895438:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311996288 00000100:00100000:1.0:1782224241.895668:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:1.0:1782224241.895680:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+15:9658:x1868797311996288:12345-192.168.202.7@tcp:35:rm.0 00000100:00100000:1.0:1782224241.895971:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+16:9658:x1868797311996288:12345-192.168.202.7@tcp:35:rm.0 Request processed in 292us (3514us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1782224241.895979:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:1.0:1782224241.899550:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224241.899637:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311996544 00000100:00100000:2.0:1782224241.899647:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311996544 00000100:00100000:2.0:1782224241.899883:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 31 00000100:00100000:2.0:1782224241.899895:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+16:9658:x1868797311996544:12345-192.168.202.7@tcp:36:rm.0 00010000:00010000:2.0:1782224241.899953:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782224241.899990:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b164abc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51561 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.900010:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b164a5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5153e expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.900054:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:2.0:1782224241.900069:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b164a1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51530 expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.900077:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96eaa7d65200) 00010000:00010000:2.0:1782224241.900083:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224241.900105:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164b02 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.900117:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164b02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.900137:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164b02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.900151:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164b09 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.900175:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164b09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.900183:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164b09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.900668:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164b10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.900678:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164b10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.900685:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164b10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224241.901908:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1782224241.901929:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164b10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.901938:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164b10 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.901945:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164b10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.901952:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab000 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224241.901967:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164b10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.901975:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164b10 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.902001:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96ea8635fc00) 00010000:00010000:2.0:1782224241.902004:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782224241.902009:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164b10 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.902078:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164b10 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.902102:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164b02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.902109:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164b02 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.902116:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164b02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.902121:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224241.902235:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164b02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.902245:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164b02 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.902255:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:2.0:1782224241.902258:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224241.902261:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164b02 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224241.902268:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164b02 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782224241.902395:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c252e576 reply state 00000000d395aec6 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164b09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224241.902405:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782224241.902551:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+15:9658:x1868797311996544:12345-192.168.202.7@tcp:36:rm.0 Request processed in 2654us (3004us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1782224241.902560:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 31 00010000:00010000:1.0:1782224241.904317:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164b09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.904334:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164b09 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.904354:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164b09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.904360:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224241.904364:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164b09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.904372:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164b09 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.904386:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96ea8635f000) 00010000:00010000:1.0:1782224241.904389:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224241.904393:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164b09 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224241.904399:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164b09 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224242.194543:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224242.194584:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224242.194713:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311996672 00000100:00100000:3.0:1782224242.194723:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311996672 00000100:00100000:3.0:1782224242.194775:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 250 00000100:00100000:3.0:1782224242.194784:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2347:x1868797311996672:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224242.194873:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2347:x1868797311996672:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 89us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224242.194881:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 250 00000100:00100000:0.0:1782224242.196488:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311996800 00000100:00100000:0.0:1782224242.196511:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311996800 00000100:00100000:0.0:1782224242.196601:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 103 00000100:00100000:0.0:1782224242.196612:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2346:x1868797311996800:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224242.196695:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2346:x1868797311996800:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 85us (2160us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224242.196703:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 103 00000100:00080000:2.0:1782224242.196796:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224242.260433:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782224242.260457:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf7fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333002240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782224242.260548:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224242.260873:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333002240 00000100:00100000:2.0:1782224242.260881:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333002240 00000100:00100000:2.0:1782224242.260950:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782224242.260968:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333002240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782224242.260995:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224242.261211:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333002240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 243us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224242.261218:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1782224242.261299:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabf7fc700 x1868797333002240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224242.261326:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf7fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333002240:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782224242.389191:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224243.414364:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224244.436299:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224245.460560:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224245.849819:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224245.849844:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf7ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333002368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782224245.849931:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224245.850058:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333002368 00000100:00100000:0.0:1782224245.850067:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333002368 00000100:00100000:0.0:1782224245.850139:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782224245.850148:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333002368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782224245.850181:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782224245.850242:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333002368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224245.850249:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1782224245.850290:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabf7ff800 x1868797333002368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224245.850308:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf7ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333002368:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782224245.851315:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1782224245.860665:0:11456:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1782224246.486347:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782224246.683525:0:11504:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9b57b4f0 20000000:00000080:2.0:1782224246.683542:0:11504:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96eabf722c00 uarg=0000000000000000 20000000:01000000:2.0:1782224246.683579:0:11504:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1782224246.683586:0:11504:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1782224246.683597:0:11504:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1782224246.685931:0:11505:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1782224246.687931:0:11504:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1782224246.693703:0:11504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1782224246.693757:0:11504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1782224246.693815:0:11504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1782224246.693843:0:11504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782224246.693861:0:11504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b164b17 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.693879:0:11504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1649b9 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.693887:0:11504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96eabbbab800/0xcfd8b3ae4b1649ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1649c7 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.693894:0:11504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96eabbbab400/0xcfd8b3ae4b1649dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1649d5 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.693902:0:11504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96eabbb87600/0xcfd8b3ae4b1649e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5151b expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.693922:0:11504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea99876a00/0xcfd8b3ae4b1649ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51522 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.693932:0:11504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b164b17 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.693971:0:11504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea99876a00/0xcfd8b3ae4b1649ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51522 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.693987:0:11504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96ea99876a00/0xcfd8b3ae4b1649ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51522 expref: 12 pid: 5780 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224246.694001:0:11504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc898000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11504:1868797333002496:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224246.694305:0:11504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96eabbb87600/0xcfd8b3ae4b1649e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5151b expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.694323:0:11504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96eabbb87600/0xcfd8b3ae4b1649e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5151b expref: 12 pid: 5781 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224246.694331:0:11504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc898700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11504:1868797333002624:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224246.694557:0:11504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96eabbbab400/0xcfd8b3ae4b1649dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b1649d5 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.694567:0:11504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96eabbbab400/0xcfd8b3ae4b1649dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1649d5 expref: 18 pid: 5781 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224246.694576:0:11504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11504:1868797333002752:0@lo:104: 00000100:00100000:3.0:1782224246.694615:0:11504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782224246.694654:0:11504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96eabbbab800/0xcfd8b3ae4b1649ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b1649c7 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.694661:0:11504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96eabbbab800/0xcfd8b3ae4b1649ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1649c7 expref: 18 pid: 5781 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224246.694668:0:11504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11504:1868797333002880:0@lo:104: 00000100:00100000:3.0:1782224246.694685:0:11504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782224246.694709:0:11504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b1649b9 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.694716:0:11504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1649b9 expref: 18 pid: 5779 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224246.694722:0:11504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11504:1868797333003008:0@lo:104: 00000100:00100000:3.0:1782224246.694741:0:11504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224246.694756:0:11504:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07300 going to sleep for 11 seconds 00000100:00100000:0.0:1782224246.695152:0:5769:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782224246.695171:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333002752 00000100:00100000:0.0:1782224246.695178:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333002752 00000100:00100000:0.0:1782224246.695216:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333002880 00000100:00100000:0.0:1782224246.695219:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333002880 00000100:00100000:0.0:1782224246.695230:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333003008 00000100:00100000:0.0:1782224246.695232:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333003008 00000100:00100000:0.0:1782224246.695245:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782224246.695254:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc898e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b33607d9-62cb-4729-8187-59883763158a+5:11504:x1868797333002752:12345-0@lo:104: 00010000:00010000:0.0:1782224246.695269:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1649d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1649dc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.695356:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782224246.695362:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc898e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b33607d9-62cb-4729-8187-59883763158a+5:11504:x1868797333002752:12345-0@lo:104: Request processed in 110us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224246.695369:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782224246.695387:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782224246.695393:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc89a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b33607d9-62cb-4729-8187-59883763158a+4:11504:x1868797333002880:12345-0@lo:104: 00010000:00010000:0.0:1782224246.695400:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b1649c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1649ce expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.695597:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782224246.695603:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc89a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b33607d9-62cb-4729-8187-59883763158a+4:11504:x1868797333002880:12345-0@lo:104: Request processed in 211us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224246.695608:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782224246.695622:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782224246.695627:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e984d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b33607d9-62cb-4729-8187-59883763158a+3:11504:x1868797333003008:12345-0@lo:104: 00010000:00010000:0.0:1782224246.695635:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96ea90674200/0xcfd8b3ae4b1649b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1649c0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.695676:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782224246.695681:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e984d33c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b33607d9-62cb-4729-8187-59883763158a+3:11504:x1868797333003008:12345-0@lo:104: Request processed in 54us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224246.695686:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1782224246.695721:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782224246.695726:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1649d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1649dc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.695733:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876600 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:0.0:1782224246.695738:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1649d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b1649dc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.695746:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1649d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b1649dc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782224246.695752:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1649d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b1649dc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782224246.695758:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782224246.695787:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1649d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1649dc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.695793:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782224246.695812:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1649d5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1649dc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.695819:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea99876600/0xcfd8b3ae4b1649d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1649dc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.695843:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782224246.695846:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b1649c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1649ce expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.695851:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87400 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:0.0:1782224246.695854:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b1649c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b1649ce expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.695859:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b1649c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b1649ce expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782224246.695864:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b1649c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b1649ce expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782224246.695868:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782224246.695881:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b1649c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1649ce expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.695886:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782224246.695892:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b1649c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1649ce expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.695897:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabbb87400/0xcfd8b3ae4b1649c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1649ce expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.695904:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224246.695907:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea90674200/0xcfd8b3ae4b1649b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1649c0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.695938:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674200 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:0.0:1782224246.695940:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea90674200/0xcfd8b3ae4b1649b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b1649c0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.695946:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea90674200/0xcfd8b3ae4b1649b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b1649c0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782224246.695951:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea90674200/0xcfd8b3ae4b1649b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b1649c0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782224246.695956:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782224246.695968:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96ea90674200/0xcfd8b3ae4b1649b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1649c0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.695973:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782224246.695987:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea90674200/0xcfd8b3ae4b1649b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1649c0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.695993:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea90674200/0xcfd8b3ae4b1649b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1649c0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.696007:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224246.696009:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224246.696011:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224246.696043:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797333003392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782224246.696077:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224246.696119:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333003392 00000100:00100000:0.0:1782224246.696123:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333003392 00010000:00010000:0.0:1782224246.696141:0:8291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1649b9 expref: 19 pid: 5779 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224246.696168:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782224246.696174:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b33607d9-62cb-4729-8187-59883763158a+19:3303:x1868797333003392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782224246.696185:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224246.696190:0:8291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1649b9 expref: 19 pid: 5779 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.696199:0:8291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1649b9 expref: 19 pid: 5779 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.696214:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224246.696243:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b33607d9-62cb-4729-8187-59883763158a+19:3303:x1868797333003392:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224246.696250:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782224246.696280:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797333003392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782224246.696377:0:11504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11504:1868797333002752:0@lo:104: 00000100:00100000:1.0:1782224246.696385:0:11504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11504:1868797333002880:0@lo:104: 00010000:00010000:1.0:1782224246.696399:0:11504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b1649c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b1649b9 expref: 18 pid: 5779 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224246.696408:0:11504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11504:1868797333003008:0@lo:104: 00010000:00010000:3.0:1782224246.697436:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224246.698256:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797333003264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782224246.698321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224246.699227:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782224246.699238:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797333003136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782224246.699287:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224246.699731:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333003264 00000100:00100000:0.0:1782224246.699740:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333003264 00010000:00010000:0.0:1782224246.699778:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96eabbbab800/0xcfd8b3ae4b1649ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1649c7 expref: 18 pid: 5781 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224246.699812:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333003136 00000100:00100000:0.0:1782224246.699815:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333003136 00010000:00010000:0.0:1782224246.699826:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96eabbbab400/0xcfd8b3ae4b1649dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1649d5 expref: 19 pid: 5781 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224246.699839:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782224246.699847:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc898e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797333003264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782224246.699861:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224246.699880:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96eabbbab800/0xcfd8b3ae4b1649ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1649c7 expref: 19 pid: 5781 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.699889:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96eabbbab800/0xcfd8b3ae4b1649ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1649c7 expref: 19 pid: 5781 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.699905:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabbbab800/0xcfd8b3ae4b1649ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b1649c7 expref: 19 pid: 5781 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.699929:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224246.699986:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc898e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b33607d9-62cb-4729-8187-59883763158a+18:3306:x1868797333003264:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224246.699993:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782224246.700009:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782224246.700032:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea860b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b33607d9-62cb-4729-8187-59883763158a+17:3306:x1868797333003136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782224246.700133:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224246.700140:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96eabbbab400/0xcfd8b3ae4b1649dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1649d5 expref: 17 pid: 5781 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.700148:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96eabbbab400/0xcfd8b3ae4b1649dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1649d5 expref: 17 pid: 5781 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.700158:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabbbab400/0xcfd8b3ae4b1649dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b1649d5 expref: 17 pid: 5781 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224246.700166:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224246.700192:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea860b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b33607d9-62cb-4729-8187-59883763158a+16:3306:x1868797333003136:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224246.700197:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782224246.700252:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797333003136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782224246.700266:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797333003264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782224246.721194:0:11504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc898000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11504:1868797333002496:192.168.202.7@tcp:104: 00000100:00100000:0.0:1782224246.721293:0:11504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc898700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11504:1868797333002624:192.168.202.7@tcp:104: 00010000:00010000:0.0:1782224246.721331:0:11504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b164b17 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224246.728564:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224246.728707:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224246.728847:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311997056 00000100:00100000:3.0:1782224246.728858:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311997056 00010000:00010000:3.0:1782224246.728898:0:8291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96eabbb87600/0xcfd8b3ae4b1649e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5151b expref: 13 pid: 5781 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224246.728942:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311996928 00000100:00100000:3.0:1782224246.728945:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311996928 00010000:00010000:3.0:1782224246.728956:0:8291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea99876a00/0xcfd8b3ae4b1649ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51522 expref: 14 pid: 5780 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224246.728980:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:3.0:1782224246.728989:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4fff53da-03fa-4566-9f6c-b379e18824a7+14:2346:x1868797311997056:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224246.729009:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224246.729034:0:8291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96eabbb87600/0xcfd8b3ae4b1649e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5151b expref: 14 pid: 5781 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.729044:0:8291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96eabbb87600/0xcfd8b3ae4b1649e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5151b expref: 14 pid: 5781 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.729061:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabbb87600/0xcfd8b3ae4b1649e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5151b expref: 14 pid: 5781 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.729093:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224246.729148:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2346:x1868797311997056:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 159us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224246.729156:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:3.0:1782224246.729186:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 34 00000100:00100000:3.0:1782224246.729194:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4fff53da-03fa-4566-9f6c-b379e18824a7+12:2346:x1868797311996928:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224246.729202:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224246.729207:0:8291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea99876a00/0xcfd8b3ae4b1649ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51522 expref: 12 pid: 5780 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.729216:0:8291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea99876a00/0xcfd8b3ae4b1649ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51522 expref: 12 pid: 5780 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.729226:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea99876a00/0xcfd8b3ae4b1649ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51522 expref: 12 pid: 5780 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.729248:0:8291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b164b17 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.729257:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b164b17 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.729272:0:8291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b164b17 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.729279:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b164b17 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.729296:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b164b17 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.729304:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b164b17 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.729310:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674800 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224246.729313:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b164b17 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.729322:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b164b17 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.729346:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b164b17 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.729357:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224246.729378:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4fff53da-03fa-4566-9f6c-b379e18824a7+11:2346:x1868797311996928:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 185us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224246.729385:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 34 00010000:00010000:1.0:1782224246.730781:0:11504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b164b17 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224246.730796:0:11504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b164b17 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224246.730803:0:11504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90674800/0xcfd8b3ae4b164b17 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224246.882637:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797333003648:0@lo:400:kworker.0 00000100:00100000:1.0:1782224246.882709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224246.882762:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782224246.882768:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333003776:0@lo:400:kworker.0 00000100:00100000:1.0:1782224246.882796:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224246.886724:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333003776 00000100:00100000:3.0:1782224246.886740:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333003776 00000100:00100000:3.0:1782224246.886894:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782224246.886905:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333003776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224246.887033:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333003776:12345-0@lo:400:kworker.0 Request processed in 129us (4235us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224246.887041:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1782224246.888300:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabfcbbb80 x1868797333003776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224246.888325:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333003776:0@lo:400:kworker.0 00000100:00100000:0.0:1782224246.888815:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868797333003520:0@lo:400:kworker.0 00000100:00100000:0.0:1782224246.888879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224246.888964:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333004032:0@lo:400:kworker.0 00000100:00100000:0.0:1782224246.888989:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224246.889052:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782224246.889059:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1868797333003904:0@lo:400:kworker.0 00000100:00100000:0.0:1782224246.889082:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224246.889122:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333003648 00000100:00100000:0.0:1782224246.889129:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333003648 00000100:00100000:0.0:1782224246.889178:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333003520 00000100:00100000:0.0:1782224246.889181:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333003520 00000100:00100000:0.0:1782224246.889195:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333003904 00000100:00100000:0.0:1782224246.889198:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333003904 00000100:00100000:0.0:1782224246.889212:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782224246.889220:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797333003648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224246.889622:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797333003648:12345-0@lo:400:kworker.0 Request processed in 401us (6911us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224246.889630:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782224246.889650:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782224246.889656:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868797333003520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224246.889690:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868797333003520:12345-0@lo:400:kworker.0 Request processed in 34us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224246.889703:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782224246.889716:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782224246.889721:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868797333003904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224246.889751:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868797333003904:12345-0@lo:400:kworker.0 Request processed in 30us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224246.889756:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782224246.892060:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797333003648:0@lo:400:kworker.0 00000100:00100000:0.0:1782224246.892107:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1868797333003904:0@lo:400:kworker.0 00000100:00100000:0.0:1782224246.892120:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868797333003520:0@lo:400:kworker.0 00000100:00100000:2.0:1782224246.892652:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333004032 00000100:00100000:2.0:1782224246.892661:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333004032 00000100:00100000:2.0:1782224246.892714:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782224246.892724:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333004032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224246.892804:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333004032:12345-0@lo:400:kworker.0 Request processed in 83us (3814us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224246.892812:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1782224246.894003:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782224246.894011:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782224246.894074:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabfcbb800 x1868797333004032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224246.894088:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333004032:0@lo:400:kworker.0 00000001:00080000:3.0:1782224246.963949:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967302 is committed 00000001:00080000:3.0:1782224246.963971:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:3.0:1782224246.963977:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1782224246.963984:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1782224246.965215:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782224246.965243:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf7fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333004160:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782224246.965324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224246.965545:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333004160 00000100:00100000:3.0:1782224246.965554:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333004160 00000100:00100000:3.0:1782224246.965607:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782224246.965617:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333004160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782224246.965648:0:6582:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1782224246.965685:0:6582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a3a9571, atime: 0x6a3a9571, ctime: 0x6a3a9571, blocks: 0x1 00010000:00010000:3.0:1782224246.965693:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b164b1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.965708:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=327s v=(0 0) 00010000:00010000:3.0:1782224246.965712:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782224246.965718:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b164b1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.965735:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b164b1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.965745:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b164b1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.965753:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b164b1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224246.965804:0:6582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782224246.966520:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1868797333004160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 901us (1193us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1782224246.966531:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1782224246.966603:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96eabf7fdc00/2, rc 0, transno 4294967300 00000100:00100000:2.0:1782224246.966617:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf7fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333004160:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782224246.967103:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224246.967112:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b164b1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224246.967124:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674600 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224246.967137:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b164b1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224246.967149:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b164b1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224246.967169:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b164b1e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224246.967176:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b164b1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224246.967201:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224246.967203:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224246.967204:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224247.309543:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224247.309601:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224247.309706:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224247.309780:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311997312 00000100:00100000:2.0:1782224247.309794:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311997312 00000100:00100000:2.0:1782224247.309896:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00100000:2.0:1782224247.309921:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2346:x1868797311997312:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224247.310074:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2346:x1868797311997312:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 158us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224247.310083:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00080000:3.0:1782224247.312444:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782224247.315024:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311997184 00000100:00100000:0.0:1782224247.315044:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311997184 00000100:00100000:0.0:1782224247.315153:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311997440 00000100:00100000:0.0:1782224247.315157:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311997440 00000100:00100000:0.0:1782224247.315189:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 107 00000100:00100000:0.0:1782224247.315199:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2346:x1868797311997184:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224247.315306:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2346:x1868797311997184:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 108us (5704us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224247.315313:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 107 00000100:00100000:0.0:1782224247.315330:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 108 00000100:00100000:0.0:1782224247.315335:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2346:x1868797311997440:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224247.315355:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2346:x1868797311997440:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 20us (5650us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224247.315361:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 108 00000100:00080000:2.0:1782224247.315958:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224247.380584:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf7fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333004288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782224247.380674:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224247.381330:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333004288 00000100:00100000:0.0:1782224247.381341:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333004288 00000100:00100000:0.0:1782224247.381396:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782224247.381405:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1868797333004288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782224247.381458:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782224247.381539:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1868797333004288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224247.381547:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782224247.381600:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf7fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333004288:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782224247.509292:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224248.335327:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224248.335863:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311997568 00000100:00100000:0.0:1782224248.335879:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311997568 00000100:00100000:0.0:1782224248.335967:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 251 00000100:00100000:0.0:1782224248.335980:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+11:5565:x1868797311997568:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782224248.336005:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224248.336189:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea88a75800/0xcfd8b3ae4b164b25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5156f expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224248.336227:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea88a75800/0xcfd8b3ae4b164b25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5156f expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224248.336240:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea88a75800/0xcfd8b3ae4b164b25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5156f expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224248.336251:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a75800, rc 0) 00000100:00100000:0.0:1782224248.336327:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+12:5565:x1868797311997568:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 Request processed in 350us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224248.336347:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 251 10000000:01000000:3.0:1782224248.340164:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782224248.340176:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96eabfbe5800 from 7 10000000:01000000:3.0:1782224248.340183:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782224248.340318:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164b2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224248.340334:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164b2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224248.340347:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164b2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224248.340382:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333004416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782224248.340488:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224248.340569:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782224248.340767:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333004416 00000100:00100000:2.0:1782224248.340779:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333004416 00000100:00100000:2.0:1782224248.340838:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1782224248.340849:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+16:5783:x1868797333004416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782224248.340867:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224248.340883:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbbaa000/0xcfd8b3ae4b164b33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b164b2c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224248.340924:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbbaa000/0xcfd8b3ae4b164b33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164b2c expref: 17 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224248.340937:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbbaa000/0xcfd8b3ae4b164b33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164b2c expref: 17 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224248.340948:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaa000, rc 0) 00000100:00100000:2.0:1782224248.341006:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797333004416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224248.341037:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1782224248.341329:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333004416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782224248.341350:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164b2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164b33 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224248.341361:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164b2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164b33 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224248.341575:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333004544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224248.341611:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224248.342087:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782224248.342166:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333004544 00000100:00100000:2.0:1782224248.342173:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333004544 00000100:00100000:2.0:1782224248.342395:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1782224248.342406:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797333004544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782224248.342806:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797333004544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 401us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224248.342815:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1782224248.343203:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333004544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782224248.343260:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333004672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782224248.343317:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224248.351876:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224248.355295:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabf5b50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782224248.360438:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333004672 00000100:00100000:3.0:1782224248.360461:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333004672 00000100:00100000:3.0:1782224248.360552:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1782224248.360566:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797333004672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224248.362051:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797333004672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1480us (18724us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224248.362066:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1782224248.362125:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311997696 00000100:00100000:3.0:1782224248.362133:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311997696 00000100:00100000:3.0:1782224248.362164:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 255 00000100:00100000:3.0:1782224248.362172:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea851bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+12:5565:x1868797311997696:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224248.362955:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea851bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+12:5565:x1868797311997696:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 Request processed in 777us (11090us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224248.362965:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 255 00000100:00100000:1.0:1782224248.363123:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333004672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224248.371331:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224248.371525:0:11518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:11518:1868797333004800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782224248.371610:0:11518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224248.371772:0:11518:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabfbcdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1782224248.372160:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311997824 00000100:00100000:2.0:1782224248.372170:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311997824 00000100:00100000:2.0:1782224248.372265:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333004800 00000100:00100000:2.0:1782224248.372277:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333004800 00000100:00100000:2.0:1782224248.372298:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 256 00000100:00100000:2.0:1782224248.372308:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea90c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+12:5565:x1868797311997824:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782224248.372765:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea90c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+12:5565:x1868797311997824:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 Request processed in 291us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224248.372777:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 256 00000100:00100000:2.0:1782224248.372824:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1782224248.372831:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea90c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+17:11518:x1868797333004800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782224248.372995:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea90c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+17:11518:x1868797333004800:12345-0@lo:502:llog_process_th.0 Request processed in 164us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224248.373002:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1782224248.373528:0:11518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:11518:1868797333004800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782224248.373572:0:11518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782224248.373583:0:11518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224248.373593:0:11518:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782224248.373600:0:11518:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96eabfbe5800 00000020:00000080:1.0:1782224248.373603:0:11518:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782224248.373850:0:11518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:11518:1868797333004928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782224248.373913:0:11518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224248.373943:0:11518:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabfbcdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782224248.374044:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333004928 00000100:00100000:0.0:1782224248.374052:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333004928 00000100:00100000:0.0:1782224248.374086:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1782224248.374095:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea90c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+17:11518:x1868797333004928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782224248.375830:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea90c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+17:11518:x1868797333004928:12345-0@lo:502:llog_process_th.0 Request processed in 1728us (1909us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224248.375846:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1782224248.377369:0:11518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:11518:1868797333004928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782224248.377432:0:11518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782224248.377443:0:11518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224248.377446:0:11518:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1782224248.377452:0:11518:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:0.0:1782224248.377845:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224248.377910:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311997952 00000100:00100000:0.0:1782224248.377918:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311997952 00000100:00100000:0.0:1782224248.377975:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 259 00000100:00100000:0.0:1782224248.377988:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea90c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+12:9928:x1868797311997952:12345-192.168.202.7@tcp:502:llog_process_th.0 00000020:01000000:3.0:1782224248.377995:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1782224248.378049:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782224248.378064:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164b2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164b33 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224248.378078:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164b2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164b33 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224248.378104:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782224248.378107:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96ea8341a800 from 7 10000000:01000000:3.0:1782224248.378110:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782224248.378152:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675200/0xcfd8b3ae4b164b3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224248.378161:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea90675200/0xcfd8b3ae4b164b3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224248.378172:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea90675200/0xcfd8b3ae4b164b3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224248.378200:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333005056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782224248.378261:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224248.378301:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07000 going to sleep for 11 seconds 00000100:00100000:1.0:1782224248.378323:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333005056 00000100:00100000:1.0:1782224248.378329:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333005056 00000100:00100000:1.0:1782224248.378367:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1782224248.378375:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+17:5783:x1868797333005056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782224248.378386:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224248.378400:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b164b41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b164b3a expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224248.378427:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b164b41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164b3a expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224248.378438:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b164b41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164b3a expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224248.378448:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99877600, rc 0) 00000100:00100000:1.0:1782224248.378494:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797333005056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224248.378502:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1782224248.378592:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333005056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782224248.378731:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea90675200/0xcfd8b3ae4b164b3a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164b41 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224248.378742:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea90675200/0xcfd8b3ae4b164b3a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164b41 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224248.378795:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333005184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224248.378839:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224248.378866:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07000 going to sleep for 11 seconds 00000100:00100000:3.0:1782224248.378880:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333005184 00000100:00100000:3.0:1782224248.378884:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333005184 00000100:00100000:3.0:1782224248.378926:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1782224248.378932:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797333005184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224248.379218:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797333005184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224248.379225:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1782224248.379256:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333005184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224248.379285:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333005312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224248.379322:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224248.379335:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07000 going to sleep for 11 seconds 00000100:00100000:3.0:1782224248.379347:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333005312 00000100:00100000:3.0:1782224248.379349:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333005312 00000100:00100000:3.0:1782224248.379365:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1782224248.379371:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797333005312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224248.381000:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797333005312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1009us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224248.381040:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1782224248.381120:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333005312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224248.381521:0:11519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:11519:1868797333005440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224248.381584:0:11519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224248.381744:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333005440 00000100:00100000:3.0:1782224248.381751:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333005440 00000100:00100000:3.0:1782224248.381784:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1782224248.381792:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:11519:x1868797333005440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224248.382003:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:11519:x1868797333005440:12345-0@lo:502:llog_process_th.0 Request processed in 210us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224248.382038:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1782224248.382080:0:11519:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07300 going to sleep for 11 seconds 00000100:00100000:3.0:1782224248.382095:0:11519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:11519:1868797333005440:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782224248.382123:0:11519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782224248.382135:0:11519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224248.382138:0:11519:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782224248.382147:0:11519:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96ea8341a800 00000020:00000080:3.0:1782224248.382149:0:11519:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782224248.382228:0:11519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:11519:1868797333005568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224248.382262:0:11519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224248.382279:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333005568 00000100:00100000:3.0:1782224248.382283:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333005568 00000100:00100000:3.0:1782224248.382298:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1782224248.382303:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:11519:x1868797333005568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224248.382547:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:11519:x1868797333005568:12345-0@lo:502:llog_process_th.0 Request processed in 242us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224248.382554:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1782224248.382581:0:11519:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07300 going to sleep for 11 seconds 00000100:00100000:3.0:1782224248.382593:0:11519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:11519:1868797333005568:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782224248.382753:0:11519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782224248.382758:0:11519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224248.382760:0:11519:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1782224248.382766:0:11519:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:0.0:1782224248.382818:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea90c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+12:9928:x1868797311997952:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 4829us (4974us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224248.382826:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 259 00000020:01000000:3.0:1782224248.382838:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1782224248.382860:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782224248.382872:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675200/0xcfd8b3ae4b164b3a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164b41 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224248.382891:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea90675200/0xcfd8b3ae4b164b3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164b41 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224248.382915:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782224248.382919:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96ea982ae000 from 7 10000000:01000000:3.0:1782224248.382922:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782224248.382953:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b164b48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224248.382962:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b164b48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224248.382973:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b164b48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224248.382988:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333005696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782224248.384555:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224248.384723:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07300 going to sleep for 11 seconds 00000100:00100000:0.0:1782224248.384854:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333005696 00000100:00100000:0.0:1782224248.384863:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333005696 00000100:00100000:0.0:1782224248.384930:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1782224248.384941:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+18:5783:x1868797333005696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782224248.384964:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224248.384985:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea88a75400/0xcfd8b3ae4b164b4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b164b48 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224248.385099:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea88a75400/0xcfd8b3ae4b164b4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164b48 expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224248.385113:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea88a75400/0xcfd8b3ae4b164b4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b164b48 expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224248.385124:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a75400, rc 0) 00000100:00100000:0.0:1782224248.385268:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797333005696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 327us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224248.385276:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1782224248.385298:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333005696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782224248.385321:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b164b48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164b4f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224248.385333:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b164b48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164b4f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224248.385517:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333005824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224248.385553:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224248.385591:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07300 going to sleep for 11 seconds 00000100:00100000:1.0:1782224248.385759:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333005824 00000100:00100000:1.0:1782224248.385765:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333005824 00000100:00100000:1.0:1782224248.385803:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1782224248.385811:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797333005824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782224248.386163:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797333005824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 351us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224248.386173:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1782224248.386190:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333005824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224248.386505:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333005952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224248.386551:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224248.386583:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff96e987a07300 going to sleep for 11 seconds 00000100:00100000:1.0:1782224248.386698:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333005952 00000100:00100000:1.0:1782224248.386705:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333005952 00000100:00100000:1.0:1782224248.386742:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1782224248.386750:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797333005952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782224248.386975:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:5783:x1868797333005952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224248.386983:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1782224248.391644:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224248.391763:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311998080 00000100:00100000:2.0:1782224248.391777:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311998080 00000100:00100000:2.0:1782224248.391839:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 268 00000100:00100000:2.0:1782224248.391852:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+12:9928:x1868797311998080:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782224248.391952:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b33607d9-62cb-4729-8187-59883763158a:5783:1868797333005952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782224248.392541:0:11521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:11521:1868797333006080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782224248.392669:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+12:9928:x1868797311998080:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 814us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224248.392684:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 268 00000100:00100000:1.0:1782224248.393114:0:11521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224248.393223:0:11521:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabfbcd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224248.393313:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333006080 00000100:00100000:0.0:1782224248.393321:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333006080 00000100:00100000:0.0:1782224248.393394:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1782224248.393404:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:11521:x1868797333006080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782224248.393679:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:11521:x1868797333006080:12345-0@lo:502:llog_process_th.0 Request processed in 276us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224248.393687:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1782224248.393816:0:11521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:11521:1868797333006080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782224248.393860:0:11521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782224248.393871:0:11521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224248.393873:0:11521:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782224248.393882:0:11521:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96ea982ae000 00000020:00000080:2.0:1782224248.393885:0:11521:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782224248.394003:0:11521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf7fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:11521:1868797333006208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782224248.395461:0:11521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224248.395522:0:11521:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea84f6a480 going to sleep for 11 seconds 00000100:00100000:1.0:1782224248.395609:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333006208 00000100:00100000:1.0:1782224248.395630:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333006208 00000100:00100000:1.0:1782224248.395696:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1782224248.395708:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:11521:x1868797333006208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782224248.396010:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:11521:x1868797333006208:12345-0@lo:502:llog_process_th.0 Request processed in 304us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224248.396039:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1782224248.396561:0:11521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf7fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b33607d9-62cb-4729-8187-59883763158a:11521:1868797333006208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782224248.396603:0:11521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782224248.396611:0:11521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224248.396613:0:11521:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782224248.396620:0:11521:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1782224248.398380:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1782224248.398440:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782224248.398463:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b164b48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164b4f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224248.398474:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b164b48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164b4f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224248.406734:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224248.406814:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311998208 00000100:00100000:1.0:1782224248.406832:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311998208 00000100:00100000:1.0:1782224248.407373:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 271 00000100:00100000:1.0:1782224248.407388:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+12:5565:x1868797311998208:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782224248.407411:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224248.407434:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea99876a00/0xcfd8b3ae4b164b56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51576 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224248.408334:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea99876a00/0xcfd8b3ae4b164b56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51576 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224248.408355:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea99876a00/0xcfd8b3ae4b164b56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51576 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224248.408366:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99876a00, rc 0) 00000100:00100000:1.0:1782224248.408510:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:5565:x1868797311998208:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 Request processed in 1124us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224248.408520:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 271 00000100:00100000:1.0:1782224248.413056:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224248.413169:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311998336 00000100:00100000:3.0:1782224248.413183:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311998336 00000100:00100000:3.0:1782224248.413258:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 272 00000100:00100000:3.0:1782224248.413270:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83492450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:5565:x1868797311998336:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224248.413697:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83492450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:5565:x1868797311998336:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 Request processed in 427us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224248.413706:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 272 00000100:00100000:3.0:1782224248.423468:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224248.423529:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311998464 00000100:00100000:1.0:1782224248.423541:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311998464 00000100:00100000:1.0:1782224248.423600:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 273 00000100:00100000:1.0:1782224248.423617:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:5565:x1868797311998464:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782224248.423904:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:5565:x1868797311998464:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 Request processed in 280us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224248.423911:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 273 00000100:00100000:2.0:1782224248.428323:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224248.428446:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311998592 00000100:00100000:3.0:1782224248.428472:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311998592 00000100:00100000:3.0:1782224248.428547:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 274 00000100:00100000:3.0:1782224248.428559:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:9931:x1868797311998592:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782224248.428904:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:9931:x1868797311998592:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 337us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224248.428914:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 274 00000040:00080000:3.0:1782224248.433008:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782224248.441217:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224248.441268:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311998720 00000100:00100000:3.0:1782224248.441281:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311998720 00000100:00100000:3.0:1782224248.441352:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 275 00000100:00100000:3.0:1782224248.441363:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:9931:x1868797311998720:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782224248.441691:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:9931:x1868797311998720:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 329us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224248.441700:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 275 00010000:00010000:1.0:1782224248.535580:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782224249.493139:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782224249.556309:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224250.587322:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224250.965716:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf7fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333006336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782224250.965817:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224250.966060:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333006336 00000100:00100000:1.0:1782224250.966071:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333006336 00000100:00100000:1.0:1782224250.966156:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782224250.966168:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333006336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782224250.966218:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224250.966287:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333006336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224250.966295:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1782224250.966354:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabf7fce00 x1868797333006336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224250.966377:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf7fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333006336:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782224250.966619:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782224251.604618:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224251.990178:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797333006464:0@lo:400:kworker.0 00000100:00100000:3.0:1782224251.990281:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224251.990343:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1868797333006976:0@lo:400:kworker.0 00000100:00100000:3.0:1782224251.990380:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224251.990411:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782224251.990417:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333006848:0@lo:400:kworker.0 00000100:00100000:3.0:1782224251.990446:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224251.990483:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333006464 00000100:00100000:3.0:1782224251.990492:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333006464 00000100:00100000:3.0:1782224251.990551:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1782224251.990561:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3304:x1868797333006464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224251.990623:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3304:x1868797333006464:12345-0@lo:400:kworker.0 Request processed in 63us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224251.990633:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1782224251.990702:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797333006464:0@lo:400:kworker.0 00000100:00100000:0.0:1782224251.993058:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333006592:0@lo:400:kworker.0 00000100:00100000:0.0:1782224251.993171:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224251.993230:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333007104:0@lo:400:kworker.0 00000100:00100000:0.0:1782224251.993299:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224251.993334:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782224251.993342:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797333006720:0@lo:400:kworker.0 00000100:00100000:0.0:1782224251.993369:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224251.993418:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333006976 00000100:00100000:0.0:1782224251.993427:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333006976 00000100:00100000:0.0:1782224251.993490:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333006592 00000100:00100000:0.0:1782224251.993493:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333006592 00000100:00100000:0.0:1782224251.993507:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333006720 00000100:00100000:0.0:1782224251.993509:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333006720 00000100:00100000:0.0:1782224251.993526:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782224251.993535:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868797333006976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224251.993606:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868797333006976:12345-0@lo:400:kworker.0 Request processed in 71us (3225us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224251.993614:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782224251.993634:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782224251.993640:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333006592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224251.993673:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333006592:12345-0@lo:400:kworker.0 Request processed in 34us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224251.993679:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782224251.993692:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782224251.993699:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797333006720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224251.993727:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797333006720:12345-0@lo:400:kworker.0 Request processed in 28us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224251.993732:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782224251.993916:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333006848 00000100:00100000:0.0:1782224251.993920:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333006848 00000100:00100000:0.0:1782224251.993954:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333007104 00000100:00100000:0.0:1782224251.993957:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333007104 00000100:00100000:0.0:1782224251.993975:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782224251.993981:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333006848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224251.994053:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333006848:12345-0@lo:400:kworker.0 Request processed in 72us (3606us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224251.994060:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782224251.994072:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782224251.994078:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1868797333007104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224251.994109:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1868797333007104:12345-0@lo:400:kworker.0 Request processed in 31us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224251.994114:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1782224251.994168:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc89b100 x1868797333006848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224251.994185:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333006848:0@lo:400:kworker.0 00000100:00100000:0.0:1782224251.994200:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1868797333006976:0@lo:400:kworker.0 00000100:00080000:0.0:1782224251.994316:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782224251.994322:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782224251.994414:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797333006720:0@lo:400:kworker.0 00000100:00100000:0.0:1782224251.994425:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333006592:0@lo:400:kworker.0 00000100:00100000:0.0:1782224251.994436:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333007104:0@lo:400:kworker.0 00000001:00080000:0.0:1782224252.109564:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1782224252.434539:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224252.434590:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224252.434873:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224252.434979:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224252.435104:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311998976 00000100:00100000:1.0:1782224252.435118:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311998976 00000100:00100000:1.0:1782224252.435282:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311999232 00000100:00100000:1.0:1782224252.435286:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311999232 00000100:00100000:1.0:1782224252.435312:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 112 00000100:00100000:1.0:1782224252.435323:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2349:x1868797311998976:12345-192.168.202.7@tcp:400:kworker.0 00000100:00080000:2.0:1782224252.435458:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224252.435499:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 113 00000100:00100000:2.0:1782224252.435511:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2349:x1868797311999232:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224252.435581:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2349:x1868797311999232:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 74us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224252.435692:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2349:x1868797311998976:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 370us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224252.435790:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311998848 00000100:00100000:3.0:1782224252.435795:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311998848 00000100:00100000:3.0:1782224252.435828:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 277 00000100:00100000:3.0:1782224252.435835:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2349:x1868797311998848:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224252.435887:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2349:x1868797311998848:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 52us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224252.435904:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 277 00000100:00100000:2.0:1782224252.436335:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 113 00000100:00100000:0.0:1782224252.437566:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311999104 00000100:00100000:0.0:1782224252.437579:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311999104 00000100:00100000:0.0:1782224252.437652:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00100000:0.0:1782224252.437678:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2349:x1868797311999104:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224252.437759:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2349:x1868797311999104:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 84us (2780us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224252.437767:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00080000:2.0:1782224252.438285:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782224252.440626:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 112 00000100:00100000:0.0:1782224252.503157:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782224252.503189:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333007232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782224252.503286:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224252.503424:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333007232 00000100:00100000:0.0:1782224252.503434:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333007232 00000100:00100000:0.0:1782224252.503499:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782224252.503510:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333007232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782224252.503560:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782224252.503625:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333007232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224252.503634:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782224252.503727:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1782224252.503735:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96eabf7fdc00, transno 4294967300 00000100:00100000:3.0:1782224252.503767:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333007232:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782224252.629590:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224253.652362:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224254.676811:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224255.712860:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224256.087574:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf7fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333007360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782224256.087678:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224256.087927:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333007360 00000100:00100000:2.0:1782224256.087938:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333007360 00000100:00080000:0.0:1782224256.088067:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782224256.088074:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782224256.088089:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333007360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782224256.088138:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224256.088204:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333007360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224256.088235:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1782224256.088413:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabf7fd500 x1868797333007360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224256.088440:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf7fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333007360:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782224256.724358:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224257.108838:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf5a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333007872:0@lo:400:kworker.0 00000100:00100000:1.0:1782224257.108926:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224257.108987:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782224257.108992:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf5a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797333007488:0@lo:400:kworker.0 00000100:00100000:1.0:1782224257.109042:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224257.109063:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf5a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1868797333008000:0@lo:400:kworker.0 00000100:00100000:1.0:1782224257.109088:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224257.109120:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333007872 00000100:00100000:1.0:1782224257.109129:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333007872 00000100:00100000:1.0:1782224257.109186:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782224257.109195:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333007872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224257.109246:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333007872:12345-0@lo:400:kworker.0 Request processed in 52us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224257.109253:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782224257.109278:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333008000 00000100:00100000:1.0:1782224257.109280:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333008000 00000100:00100000:1.0:1782224257.109317:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1782224257.109323:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868797333008000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224257.109361:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868797333008000:12345-0@lo:400:kworker.0 Request processed in 37us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224257.109376:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf5a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333007616:0@lo:400:kworker.0 00000100:00100000:1.0:1782224257.109398:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1782224257.109425:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224257.109467:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf5a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1868797333008000:0@lo:400:kworker.0 00010000:00080000:1.0:1782224257.109483:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabf5a1f80 x1868797333007872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224257.109493:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf5a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333007872:0@lo:400:kworker.0 00000100:00100000:2.0:1782224257.111516:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333007488 00000100:00100000:2.0:1782224257.111532:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333007488 00000100:00100000:2.0:1782224257.111604:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1782224257.111616:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3303:x1868797333007488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224257.118620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224257.118681:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf5a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333008128:0@lo:400:kworker.0 00000100:00100000:3.0:1782224257.118739:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224257.118779:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782224257.118788:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf5a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797333007744:0@lo:400:kworker.0 00000100:00100000:3.0:1782224257.118826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224257.118895:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333007616 00000100:00100000:3.0:1782224257.118903:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333007616 00000100:00100000:3.0:1782224257.118949:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333007744 00000100:00100000:3.0:1782224257.118952:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333007744 00000100:00100000:3.0:1782224257.119082:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1782224257.119667:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333007616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224257.119748:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333007616:12345-0@lo:400:kworker.0 Request processed in 86us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224257.119756:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1782224257.119780:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1782224257.119789:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797333007744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224257.119842:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797333007744:12345-0@lo:400:kworker.0 Request processed in 55us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224257.119848:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1782224257.119869:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333008128 00000100:00100000:3.0:1782224257.119873:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333008128 00000100:00100000:3.0:1782224257.119905:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782224257.119911:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333008128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224257.121533:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333008128:12345-0@lo:400:kworker.0 Request processed in 1614us (2790us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224257.121545:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1782224257.121596:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782224257.121602:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224257.121654:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf5a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797333007744:0@lo:400:kworker.0 00000100:00100000:3.0:1782224257.121670:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf5a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333007616:0@lo:400:kworker.0 00000100:00100000:3.0:1782224257.121683:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf5a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333008128:0@lo:400:kworker.0 00000100:00100000:3.0:1782224257.126558:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3303:x1868797333007488:12345-0@lo:400:kworker.0 Request processed in 14934us (17505us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224257.126575:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1782224257.126686:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf5a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797333007488:0@lo:400:kworker.0 00000100:00100000:2.0:1782224257.552682:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224257.552732:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224257.552793:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224257.552850:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311999488 00000100:00100000:2.0:1782224257.552853:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224257.552868:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311999488 00000100:00080000:2.0:1782224257.552924:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224257.552945:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311999744 00000100:00100000:3.0:1782224257.552950:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311999744 00000100:00100000:2.0:1782224257.552987:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 117 00000100:00100000:2.0:1782224257.553007:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2347:x1868797311999488:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224257.553053:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311999360 00000100:00100000:0.0:1782224257.553059:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311999360 00000100:00100000:0.0:1782224257.553102:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 279 00000100:00100000:0.0:1782224257.553113:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2347:x1868797311999360:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224257.553153:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2347:x1868797311999488:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 151us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224257.553512:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2347:x1868797311999360:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 398us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224257.553532:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 279 00000100:00100000:3.0:1782224257.563366:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 118 00000100:00100000:3.0:1782224257.563399:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2347:x1868797311999744:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224257.563503:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2347:x1868797311999744:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 121us (10769us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224257.563511:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 118 00000100:00100000:2.0:1782224257.565117:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 117 00000100:00080000:2.0:1782224257.565303:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224257.565345:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311999616 00000100:00100000:2.0:1782224257.565356:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311999616 00000100:00080000:3.0:1782224257.565437:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782224257.569440:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 67 00000100:00100000:2.0:1782224257.569477:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2347:x1868797311999616:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224257.569860:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2347:x1868797311999616:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 401us (17006us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224257.569871:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 67 00000100:00100000:3.0:1782224257.621177:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333008256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782224257.621261:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224257.625395:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333008256 00000100:00100000:0.0:1782224257.625410:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333008256 00000100:00100000:2.0:1782224257.628963:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782224257.628978:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333008256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782224257.629061:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224257.629151:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333008256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 177us (7890us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224257.629159:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782224257.629253:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333008256:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782224257.749032:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224258.773681:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782224259.733669:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782224259.796230:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224260.820242:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224261.206049:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf7fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333008384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782224261.206128:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224261.206452:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333008384 00000100:00100000:1.0:1782224261.206460:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333008384 00000100:00100000:1.0:1782224261.206527:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782224261.206536:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333008384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782224261.206573:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1782224261.206684:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782224261.206896:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333008384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 361us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224261.206903:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1782224261.206959:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabf7fce00 x1868797333008384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224261.206976:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf7fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333008384:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782224261.844236:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224262.228570:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333008640:0@lo:400:kworker.0 00000100:00100000:3.0:1782224262.228646:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224262.228711:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333009152:0@lo:400:kworker.0 00000100:00100000:3.0:1782224262.228889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224262.228931:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782224262.228939:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797333008768:0@lo:400:kworker.0 00000100:00100000:3.0:1782224262.228969:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224262.229003:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333009152 00000100:00100000:3.0:1782224262.229046:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333009152 00000100:00100000:3.0:1782224262.229105:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782224262.229114:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333009152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224262.229166:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333009152:12345-0@lo:400:kworker.0 Request processed in 53us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224262.229173:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782224262.229360:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797333008512:0@lo:400:kworker.0 00000100:00100000:1.0:1782224262.229395:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224262.229419:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1868797333009024:0@lo:400:kworker.0 00000100:00100000:1.0:1782224262.229442:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224262.229458:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782224262.229463:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333008896:0@lo:400:kworker.0 00000100:00100000:1.0:1782224262.229483:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224262.229527:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333008896 00000100:00100000:1.0:1782224262.229531:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333008896 00000100:00100000:1.0:1782224262.229567:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782224262.229574:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333008896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224262.229610:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333008896:12345-0@lo:400:kworker.0 Request processed in 37us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224262.229616:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1782224262.229632:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782224262.229643:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333008640 00000100:00100000:1.0:1782224262.229646:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333008640 00000100:00100000:1.0:1782224262.229669:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333008768 00000100:00100000:1.0:1782224262.229672:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333008768 00000100:00100000:1.0:1782224262.229688:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333009024 00000100:00100000:1.0:1782224262.229691:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333009024 00000100:00100000:1.0:1782224262.229704:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1782224262.229709:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333008640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224262.229888:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333008640:12345-0@lo:400:kworker.0 Request processed in 177us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224262.229896:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1782224262.229909:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1782224262.229916:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797333008768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224262.229943:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797333008768:12345-0@lo:400:kworker.0 Request processed in 29us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224262.229949:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1782224262.229958:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1782224262.229964:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868797333009024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224262.229986:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868797333009024:12345-0@lo:400:kworker.0 Request processed in 23us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224262.229992:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1782224262.230034:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782224262.230064:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabc89b100 x1868797333008896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224262.230078:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333008896:0@lo:400:kworker.0 00000100:00100000:1.0:1782224262.230090:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1868797333009024:0@lo:400:kworker.0 00000100:00100000:1.0:1782224262.230169:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333008512 00000100:00100000:1.0:1782224262.230174:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333008512 00000100:00100000:1.0:1782224262.230911:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1782224262.230922:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3304:x1868797333008512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224262.230973:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3304:x1868797333008512:12345-0@lo:400:kworker.0 Request processed in 54us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224262.230980:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1782224262.234147:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797333008768:0@lo:400:kworker.0 00000100:00100000:3.0:1782224262.234164:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333008640:0@lo:400:kworker.0 00000100:00100000:3.0:1782224262.234173:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333009152:0@lo:400:kworker.0 00000100:00100000:1.0:1782224262.235614:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797333008512:0@lo:400:kworker.0 00000100:00100000:2.0:1782224262.683627:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224262.683682:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224262.683709:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797311999872 00000100:00100000:0.0:1782224262.683720:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797311999872 00000100:00100000:1.0:1782224262.683814:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312000000 00000100:00100000:0.0:1782224262.683815:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 281 00000100:00100000:1.0:1782224262.683821:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312000000 00000100:00100000:0.0:1782224262.683828:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2348:x1868797311999872:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224262.683872:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 122 00000100:00100000:1.0:1782224262.683882:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2348:x1868797312000000:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224262.683908:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2348:x1868797311999872:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 81us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224262.683916:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 281 00000100:00100000:1.0:1782224262.683924:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2348:x1868797312000000:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 42us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224262.683932:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 122 00000100:00080000:1.0:1782224262.683955:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782224262.693577:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224262.693647:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312000128 00000100:00100000:1.0:1782224262.693659:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312000128 00000100:00100000:0.0:1782224262.693683:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224262.693876:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:1.0:1782224262.693888:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2345:x1868797312000128:12345-192.168.202.7@tcp:9:kworker.0 00000020:00000080:1.0:1782224262.693950:0:6584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b164a92 00000100:00080000:1.0:1782224262.693959:0:6584:0:(import.c:65:import_set_state_nolock()) ffff96ea83419800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1782224262.693974:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312000256 00000100:00100000:2.0:1782224262.693981:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312000256 00000001:00000004:1.0:1782224262.694084:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1782224262.694437:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224262.694655:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+2:2345:x1868797312000128:12345-192.168.202.7@tcp:9:kworker.0 Request processed in 766us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224262.694673:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00080000:3.0:1782224262.695086:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782224262.695092:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782224262.703858:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 123 00000100:00100000:2.0:1782224262.703884:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2349:x1868797312000256:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224262.703994:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2349:x1868797312000256:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 123us (10310us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224262.704002:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 123 00000100:00100000:3.0:1782224262.744754:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333009280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782224262.744860:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224262.745265:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333009280 00000100:00100000:2.0:1782224262.745273:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333009280 00000100:00100000:2.0:1782224262.745339:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782224262.745357:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333009280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782224262.745394:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224262.747778:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333009280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2411us (2897us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224262.747792:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782224262.748228:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333009280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782224262.868299:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224263.893100:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224264.916556:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224265.940476:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224266.324280:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333009408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782224266.324381:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224266.324857:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333009408 00000100:00100000:0.0:1782224266.324869:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333009408 00000100:00100000:0.0:1782224266.325093:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782224266.325107:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333009408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782224266.325159:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782224266.326045:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333009408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 911us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224266.326056:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1782224266.327613:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782224266.328069:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e9879d7800 x1868797333009408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224266.328103:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333009408:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782224266.964669:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224267.352418:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf5a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333009920:0@lo:400:kworker.0 00000100:00100000:1.0:1782224267.352520:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224267.352600:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782224267.352608:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf5a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797333009536:0@lo:400:kworker.0 00000100:00100000:1.0:1782224267.352641:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224267.352665:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf5a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1868797333010048:0@lo:400:kworker.0 00000100:00100000:1.0:1782224267.352694:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224267.352735:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf5a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1868797333009792:0@lo:400:kworker.0 00000100:00100000:1.0:1782224267.352761:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224267.352778:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782224267.352783:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf5a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797333009664:0@lo:400:kworker.0 00000100:00100000:1.0:1782224267.352806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224267.352822:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf5a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333010176:0@lo:400:kworker.0 00000100:00100000:0.0:1782224267.354086:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333009536 00000100:00100000:0.0:1782224267.354099:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333009536 00000100:00100000:0.0:1782224267.354175:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1782224267.354187:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3303:x1868797333009536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224267.357247:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333010048 00000100:00100000:2.0:1782224267.357269:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333010048 00000100:00100000:2.0:1782224267.357341:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333009792 00000100:00100000:2.0:1782224267.357345:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333009792 00000100:00100000:2.0:1782224267.357360:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333009664 00000100:00100000:2.0:1782224267.357362:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333009664 00000100:00100000:2.0:1782224267.357400:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1782224267.357410:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868797333010048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224267.362800:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3303:x1868797333009536:12345-0@lo:400:kworker.0 Request processed in 8525us (10066us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224267.362821:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1782224267.362927:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf5a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797333009536:0@lo:400:kworker.0 00000100:00100000:0.0:1782224267.363787:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1782224267.363807:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868797333009792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224267.363912:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868797333009792:12345-0@lo:400:kworker.0 Request processed in 114us (11150us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224267.363919:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1782224267.363942:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1782224267.363949:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797333009664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224267.363982:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797333009664:12345-0@lo:400:kworker.0 Request processed in 34us (11175us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224267.363988:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1782224267.364009:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333009920 00000100:00100000:0.0:1782224267.364050:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333009920 00000100:00100000:0.0:1782224267.364096:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782224267.364103:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333009920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224267.364143:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333009920:12345-0@lo:400:kworker.0 Request processed in 41us (11626us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224267.364149:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:0.0:1782224267.364194:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eabf5a0000 x1868797333009920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224267.364231:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf5a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333009920:0@lo:400:kworker.0 00000100:00100000:1.0:1782224267.366000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224267.366117:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf5a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1868797333009792:0@lo:400:kworker.0 00000100:00100000:1.0:1782224267.366150:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf5a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797333009664:0@lo:400:kworker.0 00000100:00100000:1.0:1782224267.366190:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333010176 00000100:00100000:1.0:1782224267.366196:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333010176 00000100:00100000:1.0:1782224267.366250:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782224267.366261:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333010176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224267.366340:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333010176:12345-0@lo:400:kworker.0 Request processed in 80us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224267.366349:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782224267.366384:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf5a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333010176:0@lo:400:kworker.0 00000100:00080000:2.0:1782224267.371107:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782224267.371124:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224267.371270:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868797333010048:12345-0@lo:400:kworker.0 Request processed in 13851us (18564us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224267.371285:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1782224267.373363:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf5a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1868797333010048:0@lo:400:kworker.0 00000001:00100000:0.0:1782224267.488384:0:7486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 00000020:00000080:0.0:1782224267.488397:0:7486:0:(genops.c:906:class_export_put()) final put ffff96eabf83b800/3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 00000020:00000080:2.0:1782224267.488793:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabf83b800/3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 for lustre-OST0001 00000020:00000080:2.0:1782224267.488977:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96ea83419800 for lustre-OST0001 00000100:00100000:0.0:1782224267.790889:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224267.790969:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224267.790997:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224267.791114:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312000512 00000100:00100000:2.0:1782224267.791128:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312000512 00000100:00100000:2.0:1782224267.791210:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312000640 00000100:00100000:2.0:1782224267.791213:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312000640 00000100:00100000:2.0:1782224267.791234:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 127 00000100:00100000:2.0:1782224267.791245:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2348:x1868797312000512:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224267.791332:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2348:x1868797312000512:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 90us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224267.791340:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 127 00000100:00100000:2.0:1782224267.791357:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 128 00000100:00100000:2.0:1782224267.791363:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2348:x1868797312000640:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224267.791380:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2348:x1868797312000640:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 18us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224267.791386:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 128 00000100:00080000:0.0:1782224267.791451:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224267.792279:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312000384 00000100:00100000:3.0:1782224267.792288:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312000384 00000100:00100000:3.0:1782224267.792335:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 283 00000100:00100000:3.0:1782224267.792343:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2348:x1868797312000384:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224267.792399:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2348:x1868797312000384:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 56us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224267.792406:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 283 00000100:00100000:0.0:1782224267.861705:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782224267.861749:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333010304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782224267.861846:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224267.861973:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333010304 00000100:00100000:3.0:1782224267.862008:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333010304 00000100:00100000:3.0:1782224267.862088:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782224267.862098:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333010304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782224267.862138:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224267.862249:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333010304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224267.862258:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782224267.862369:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333010304:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782224267.988286:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224269.013161:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782224269.972881:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782224270.038128:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782224270.756925:0:11689:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:17:49 (1782224269) 00010000:00010000:0.0:1782224271.060281:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224271.444541:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333010432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782224271.444615:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224271.444980:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333010432 00000100:00100000:3.0:1782224271.444989:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333010432 00000100:00100000:3.0:1782224271.445069:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782224271.445079:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333010432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782224271.445126:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224271.445183:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333010432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224271.445192:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1782224271.445214:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e9879d5880 x1868797333010432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782224271.445270:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782224271.450187:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333010432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782224271.757716:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224271.757993:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312000768 00000100:00100000:2.0:1782224271.758006:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312000768 00000100:00100000:2.0:1782224271.758200:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 32 00000100:00100000:2.0:1782224271.758214:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:10200:x1868797312000768:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782224271.758241:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224271.758269:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164b5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5157d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782224271.758655:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782224271.758791:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164b64 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224271.758810:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164b64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224271.758827:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164b64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224271.759133:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782224271.759138:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224271.759241:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164b64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224271.759273:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164b5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5157d expref: 7 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224271.759294:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164b64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5157d expref: 6 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224271.759304:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:2.0:1782224271.759316:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782224271.759321:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab000, rc 0) 00000100:00100000:2.0:1782224271.759419:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:10200:x1868797312000768:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 1208us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224271.759428:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 32 00000100:00100000:2.0:1782224271.773088:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224271.773204:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312000896 00000100:00100000:0.0:1782224271.773215:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312000896 00000100:00100000:0.0:1782224271.773275:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:0.0:1782224271.773284:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:10201:x1868797312000896:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782224271.773305:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224271.773341:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b164b6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51584 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.773408:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164b72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.773423:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164b72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.773434:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164b72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.773448:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164b79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.773456:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164b79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.773462:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164b79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.773898:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75600/0xcfd8b3ae4b164b80 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.773909:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75600/0xcfd8b3ae4b164b80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.773916:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75600/0xcfd8b3ae4b164b80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224271.774003:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1782224271.774008:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782224271.774125:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75600/0xcfd8b3ae4b164b80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.774142:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164b72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.774149:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164b72 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.774157:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164b72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.774163:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224271.774167:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164b72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.774175:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164b72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.774188:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:0.0:1782224271.774191:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224271.774195:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164b72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.774202:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164b72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.774214:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164b79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.774221:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164b79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.774226:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164b79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.774237:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224271.774241:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164b79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.774247:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164b79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.774255:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff96eaa7d65000) 00010000:00010000:0.0:1782224271.774257:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224271.774260:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164b79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.774267:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164b79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.774296:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b164b6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51584 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.774309:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75600/0xcfd8b3ae4b164b80 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51584 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224271.774317:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96eaa7d65800) 00010000:00010000:0.0:1782224271.774319:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782224271.774322:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a75600, rc 0) 00000100:00100000:0.0:1782224271.774398:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:10201:x1868797312000896:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 1114us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224271.774406:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:0.0:1782224271.776990:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224271.779142:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312001152 00000100:00100000:3.0:1782224271.779156:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312001152 00000100:00100000:3.0:1782224271.779336:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 34 00000100:00100000:3.0:1782224271.779345:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:10201:x1868797312001152:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782224271.779362:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224271.779380:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164b87 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5158b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.779439:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164b8e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.779460:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164b8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.779469:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164b8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.784969:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164b95 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.784995:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164b95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.785006:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164b95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.785750:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b164b9c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.785761:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b164b9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.785768:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b164b9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224271.785779:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1782224271.786010:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164b8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.786066:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164b8e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.786071:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164b8e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.786081:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224271.786084:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164b8e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.786090:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164b8e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.786099:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96eaa7d65800) 00010000:00010000:3.0:1782224271.786101:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224271.786104:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164b8e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.786108:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164b8e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.786119:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164b95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.786123:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164b95 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.786126:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164b95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.786129:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224271.786131:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164b95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.786134:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164b95 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.786144:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96ea87df7a00) 00010000:00010000:3.0:1782224271.786145:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224271.786147:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164b95 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.786150:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164b95 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.786603:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164b87 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5158b expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.786615:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b164b9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5158b expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224271.786619:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96ea87df7c00) 00010000:00010000:3.0:1782224271.786620:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224271.786622:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675800, rc 0) 00000100:00100000:3.0:1782224271.786759:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:10201:x1868797312001152:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 7414us (9777us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1782224271.786768:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 34 00000100:00100000:1.0:1782224271.790349:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224271.790517:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312001280 00000100:00100000:0.0:1782224271.790533:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312001280 00000100:00100000:0.0:1782224271.790587:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 35 00000100:00100000:0.0:1782224271.790594:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:10201:x1868797312001280:12345-192.168.202.7@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1782224271.790807:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:10201:x1868797312001280:12345-192.168.202.7@tcp:59:lhsmtool_posix.0 Request processed in 211us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224271.790815:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 35 00000040:00080000:2.0:1782224272.025860:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782224272.085817:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224272.469902:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333010688:0@lo:400:kworker.0 00000100:00100000:3.0:1782224272.470000:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224272.470072:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333011200:0@lo:400:kworker.0 00000100:00100000:3.0:1782224272.470097:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224272.470127:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782224272.470132:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797333010816:0@lo:400:kworker.0 00000100:00100000:3.0:1782224272.470161:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224272.470258:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333010688 00000100:00100000:3.0:1782224272.470265:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333010688 00000100:00100000:3.0:1782224272.470302:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333010816 00000100:00100000:3.0:1782224272.470305:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333010816 00000100:00100000:3.0:1782224272.470339:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1782224272.470348:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333010688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224272.470404:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333010688:12345-0@lo:400:kworker.0 Request processed in 57us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224272.470411:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1782224272.470428:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1782224272.470436:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797333010816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224272.470461:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797333010816:12345-0@lo:400:kworker.0 Request processed in 27us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224272.470467:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1782224272.470482:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224272.470510:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797333010816:0@lo:400:kworker.0 00000100:00100000:3.0:1782224272.470519:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333010688:0@lo:400:kworker.0 00000100:00100000:2.0:1782224272.471344:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797333010560:0@lo:400:kworker.0 00000100:00100000:2.0:1782224272.471391:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224272.471421:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1868797333011072:0@lo:400:kworker.0 00000100:00100000:2.0:1782224272.471444:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224272.471465:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782224272.471471:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333010944:0@lo:400:kworker.0 00000100:00100000:2.0:1782224272.471495:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224272.471527:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333011072 00000100:00100000:2.0:1782224272.471533:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333011072 00000100:00100000:2.0:1782224272.471571:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1782224272.471578:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868797333011072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224272.471619:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868797333011072:12345-0@lo:400:kworker.0 Request processed in 41us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224272.471626:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1782224272.471705:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333010560 00000100:00100000:2.0:1782224272.471709:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333010560 00000100:00100000:2.0:1782224272.471733:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1782224272.471740:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3304:x1868797333010560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224272.471770:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3304:x1868797333010560:12345-0@lo:400:kworker.0 Request processed in 31us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224272.471783:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1782224272.471813:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333011200 00000100:00100000:2.0:1782224272.471816:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333011200 00000100:00100000:2.0:1782224272.471844:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333010944 00000100:00100000:2.0:1782224272.471847:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333010944 00000100:00100000:2.0:1782224272.471865:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782224272.471872:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333011200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224272.471907:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333011200:12345-0@lo:400:kworker.0 Request processed in 35us (1808us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224272.471913:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782224272.471924:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782224272.471930:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333010944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224272.471955:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333010944:12345-0@lo:400:kworker.0 Request processed in 26us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224272.471961:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1782224272.471979:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782224272.471983:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782224272.472005:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e9879d6d80 x1868797333010944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782224288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224272.472040:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333010944:0@lo:400:kworker.0 00000100:00100000:2.0:1782224272.472050:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797333010560:0@lo:400:kworker.0 00000100:00100000:2.0:1782224272.472059:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1868797333011072:0@lo:400:kworker.0 00000100:00100000:3.0:1782224272.473636:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333011200:0@lo:400:kworker.0 00000001:00080000:3.0:1782224272.511487:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:2.0:1782224272.922813:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224272.922899:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224272.922941:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224272.922981:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312001536 00000100:00100000:2.0:1782224272.922991:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312001536 00000100:00100000:2.0:1782224272.923068:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312001664 00000100:00100000:2.0:1782224272.923071:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312001664 00000100:00100000:2.0:1782224272.923126:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 132 00000100:00100000:2.0:1782224272.923137:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2347:x1868797312001536:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224272.923227:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2347:x1868797312001536:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 92us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224272.923234:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 132 00000100:00100000:2.0:1782224272.923253:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 133 00000100:00100000:2.0:1782224272.923260:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2346:x1868797312001664:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224272.923286:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2346:x1868797312001664:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224272.923292:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 133 00000100:00080000:2.0:1782224272.923313:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782224272.927310:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312001408 00000100:00100000:0.0:1782224272.927326:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312001408 00000100:00100000:0.0:1782224272.927444:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 285 00000100:00100000:0.0:1782224272.927456:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2346:x1868797312001408:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224272.927546:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2346:x1868797312001408:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 92us (4743us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224272.927553:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 285 00000100:00100000:3.0:1782224272.984677:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782224272.984703:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333011328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782224272.984777:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224272.984832:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333011328 00000100:00100000:3.0:1782224272.984838:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333011328 00000100:00100000:3.0:1782224272.984880:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782224272.984896:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333011328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782224272.984930:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224272.984973:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333011328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224272.984980:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782224272.985649:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333011328:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782224273.111783:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224273.567572:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224273.567829:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312001792 00000100:00100000:2.0:1782224273.567840:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312001792 00000100:00100000:2.0:1782224273.567957:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00100000:2.0:1782224273.567969:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:10244:x1868797312001792:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1782224273.567991:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224273.568011:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164baa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51592 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568104:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164bb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568119:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568140:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568156:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568164:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568170:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568408:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568417:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164bb1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568422:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164bb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568428:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbabc00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224273.568433:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164bb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568441:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164bb1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568453:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:2.0:1782224273.568456:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224273.568461:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164bb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568473:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164bb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568486:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568491:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bb8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568496:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568500:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224273.568503:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568509:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bb8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568516:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff96ea8635fd00) 00010000:00010000:2.0:1782224273.568518:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224273.568521:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bb8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568527:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568555:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164baa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51592 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568576:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:2.0:1782224273.568579:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224273.568583:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164baa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51592 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.568592:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbabe00, rc 0) 00000100:00100000:2.0:1782224273.568649:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:10244:x1868797312001792:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 683us (1085us total) trans 0 rc 301/301 00000100:00100000:2.0:1782224273.568667:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00080000:0.0:1782224273.574942:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224273.586712:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224273.587427:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312002048 00000100:00100000:2.0:1782224273.587438:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312002048 00000100:00100000:2.0:1782224273.587500:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00100000:2.0:1782224273.587510:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:10244:x1868797312002048:12345-192.168.202.7@tcp:36:lfs.0 00010000:00010000:2.0:1782224273.587566:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224273.587593:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164b64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5157d expref: 8 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.587611:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:2.0:1782224273.587621:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224273.587907:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164bbf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.587922:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164bbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.587932:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164bbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.587957:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bc6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.587964:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.587971:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224273.588966:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1782224273.588979:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164bbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.588987:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164bbf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.588994:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164bbf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.589000:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbabe00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224273.589004:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164bbf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.589011:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164bbf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.589047:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fd00) 00010000:00010000:2.0:1782224273.589051:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224273.589055:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164bbf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.589072:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b164bbf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782224273.589087:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000091d7cc4c reply state 00000000e651d59f transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224273.589096:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782224273.589205:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:10244:x1868797312002048:12345-192.168.202.7@tcp:36:lfs.0 Request processed in 1693us (2498us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1782224273.589213:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 37 00010000:00010000:3.0:1782224273.593901:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.593919:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bc6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.593927:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bc6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.593934:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224273.593939:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bc6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.593947:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bc6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.593964:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff96ea8635fa00) 00010000:00010000:3.0:1782224273.593967:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224273.593972:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bc6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.593978:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164bc6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224273.671434:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224273.671555:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312002176 00000100:00100000:2.0:1782224273.671567:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312002176 00000100:00100000:2.0:1782224273.671631:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 38 00000100:00100000:2.0:1782224273.671643:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:10252:x1868797312002176:12345-192.168.202.7@tcp:101:lctl.0 00010000:00010000:2.0:1782224273.671699:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224273.671721:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164bcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51599 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.671780:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164bd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.671790:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.671800:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224273.671920:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782224273.671923:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224273.671972:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.671990:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164bcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51599 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.672004:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164bd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51599 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.672011:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fd00) 00010000:00010000:2.0:1782224273.672726:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782224273.672732:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbabc00, rc 0) 00000100:00100000:2.0:1782224273.672818:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:10252:x1868797312002176:12345-192.168.202.7@tcp:101:lctl.0 Request processed in 1175us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224273.672826:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 38 00000100:00100000:2.0:1782224273.722244:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224273.722430:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312002304 00000100:00100000:3.0:1782224273.722439:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312002304 00000100:00100000:3.0:1782224273.722488:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:3.0:1782224273.722496:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:10258:x1868797312002304:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:3.0:1782224273.722517:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224273.722539:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164bdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a515a0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722609:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164be2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722626:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164be2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722637:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164be2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722648:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164be9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722653:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164be9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722667:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164be9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722764:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b164bf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722785:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b164bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722789:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b164bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224273.722821:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1782224273.722825:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782224273.722870:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b164bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722883:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164be2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722890:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164be2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722896:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164be2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722903:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224273.722906:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164be2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722914:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164be2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722925:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fd00) 00010000:00010000:3.0:1782224273.722928:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224273.722933:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164be2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722950:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164be2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722967:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164be9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722973:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164be9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722979:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164be9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722985:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224273.722988:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164be9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722994:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164be9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.722999:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff96ea87df7a00) 00010000:00010000:3.0:1782224273.723001:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224273.723003:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164be9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.723007:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164be9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.723180:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164bdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515a0 expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.723189:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b164bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515a0 expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224273.723199:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:3.0:1782224273.723200:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782224273.723202:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674a00, rc 0) 00000100:00100000:3.0:1782224273.723267:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+10:10258:x1868797312002304:12345-192.168.202.7@tcp:101:bash.0 Request processed in 771us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224273.723273:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:0.0:1782224273.728548:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224273.728707:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312002560 00000100:00100000:1.0:1782224273.728718:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312002560 00000100:00100000:1.0:1782224273.728832:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 40 00000100:00100000:1.0:1782224273.728844:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+10:10258:x1868797312002560:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1782224273.728867:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224273.728888:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164bf7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a515a7 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.729045:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164bfe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.729060:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164bfe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.729084:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164bfe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.730493:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164c05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.730517:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.730529:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782224273.731650:0:6605:0:(osp_object.c:1673:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1782224273.731971:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164c0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.731984:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.731994:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.732163:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164bfe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.732170:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164bfe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.732177:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164bfe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.732183:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224273.732196:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164bfe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.732205:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164bfe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.732219:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:1.0:1782224273.732223:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224273.732227:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164bfe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.732724:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164bfe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782224273.732744:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063a7adaa reply state 00000000dc0e9175 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224273.732753:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782224273.732796:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164bf7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515a7 expref: 13 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.732812:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515a7 expref: 12 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.732821:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508f900) 00010000:00010000:1.0:1782224273.732823:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782224273.732826:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99877a00, rc 0) 00000100:00100000:1.0:1782224273.732988:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:10258:x1868797312002560:12345-192.168.202.7@tcp:101:bash.0 Request processed in 4145us (4449us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1782224273.732998:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 40 00010000:00010000:0.0:1782224273.737487:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224273.737505:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164c05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224273.737514:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164c05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224273.737520:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224273.737525:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164c05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224273.737549:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164c05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224273.737566:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96ea8508fc00) 00010000:00010000:0.0:1782224273.737569:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224273.737574:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164c05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224273.737579:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164c05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224273.738613:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224273.738762:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312002688 00000100:00100000:0.0:1782224273.738774:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312002688 00000100:00100000:0.0:1782224273.738974:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:0.0:1782224273.738992:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1868797312002688:12345-192.168.202.7@tcp:8:bash.0 00010000:00080000:0.0:1782224273.739249:0:6582:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp t0 exp 0000000000000000 cur 354 last 0 00000020:00000080:0.0:1782224273.739281:0:6582:0:(genops.c:1406:class_connect()) connect: client 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39, cookie 0xcfd8b3ae4b164c1a 00002000:00100000:0.0:1782224273.739292:0:6582:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39/ffff96ea83555000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782224273.739392:0:6582:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:0.0:1782224273.739632:0:6582:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782224273.739678:0:6582:0:(import.c:65:import_set_state_nolock()) ffff96ea83552800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782224273.739808:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2345:x1868797312002688:12345-192.168.202.7@tcp:8:bash.0 Request processed in 823us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224273.739817:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:3.0:1782224273.743266:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224273.746700:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312002816 00000100:00100000:1.0:1782224273.746718:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312002816 00000100:00100000:1.0:1782224273.746817:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:1.0:1782224273.746828:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:0:x1868797312002816:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1782224273.746848:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224273.746873:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a378ba7d/0xcfd8b3ae4b164c21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a515ae expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782224273.746899:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224273.746919:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=354s v=(0 0) 00010000:00010000:1.0:1782224273.746923:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224273.746933:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a378ba7d/0xcfd8b3ae4b164c21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515ae expref: 7 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.746954:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a378ba7d/0xcfd8b3ae4b164c21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515ae expref: 7 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.746968:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99876c00, rc 0) 00000100:00100000:1.0:1782224273.747071:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:0:x1868797312002816:12345-192.168.202.7@tcp:101:bash.0 Request processed in 244us (3814us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224273.747079:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00080000:0.0:1782224273.747887:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782224273.751749:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224273.751856:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312002944 00000100:00100000:1.0:1782224273.751867:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312002944 00000100:00100000:1.0:1782224273.751930:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:1.0:1782224273.751941:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:10258:x1868797312002944:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1782224273.751961:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224273.751995:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afa46d54/0xcfd8b3ae4b164c28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a515b5 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.752064:0:6715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a378ba7d/0xcfd8b3ae4b164c21 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515ae expref: 8 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.752073:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224273.752077:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224273.752082:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afa46d54/0xcfd8b3ae4b164c28 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515b5 expref: 8 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.752117:0:6715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a378ba7d/0xcfd8b3ae4b164c21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515ae expref: 8 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.752130:0:6715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a378ba7d/0xcfd8b3ae4b164c21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515ae expref: 8 pid: 6584 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224273.752145:0:6715:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf5a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6715:1868797333011456:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224273.753460:0:6715:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782224273.756795:0:6715:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf5a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6715:1868797333011456:192.168.202.7@tcp:104: 00010000:00010000:1.0:1782224273.756834:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afa46d54/0xcfd8b3ae4b164c28 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515b5 expref: 8 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.756854:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99876200, rc 0) 00000100:00100000:1.0:1782224273.756916:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:10258:x1868797312002944:12345-192.168.202.7@tcp:101:bash.0 Request processed in 4976us (5176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224273.756939:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:3.0:1782224273.764829:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224273.765292:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312003072 00000100:00100000:1.0:1782224273.765303:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312003072 00010000:00010000:1.0:1782224273.765362:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a378ba7d/0xcfd8b3ae4b164c21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515ae expref: 8 pid: 6584 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224273.765411:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 35 00000100:00100000:1.0:1782224273.765421:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83516300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2346:x1868797312003072:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782224273.765438:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224273.765463:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a378ba7d/0xcfd8b3ae4b164c21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515ae expref: 8 pid: 6584 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.765478:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a378ba7d/0xcfd8b3ae4b164c21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515ae expref: 8 pid: 6584 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.765502:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a378ba7d/0xcfd8b3ae4b164c21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515ae expref: 8 pid: 6584 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.765519:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224273.765524:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224273.765532:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afa46d54/0xcfd8b3ae4b164c28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515b5 expref: 7 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.765542:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afa46d54/0xcfd8b3ae4b164c28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515b5 expref: 7 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224273.765602:0:5770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000afa46d54/0xcfd8b3ae4b164c28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515b5 expref: 7 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224273.765617:0:5770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf5a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5770:1868797333011584:192.168.202.7@tcp:105: 00000100:00100000:1.0:1782224273.765712:0:5770:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782224273.771510:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224273.771625:0:5770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf5a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5770:1868797333011584:192.168.202.7@tcp:105: 00010000:00010000:1.0:1782224273.771652:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224273.771749:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83516300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312003072:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 6329us (6930us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224273.771760:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 35 00000100:00100000:2.0:1782224273.775342:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312003328 00000100:00100000:2.0:1782224273.775358:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312003328 00000100:00100000:2.0:1782224273.775427:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:2.0:1782224273.775438:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+12:10258:x1868797312003328:12345-192.168.202.7@tcp:35:bash.0 00000100:00100000:2.0:1782224273.775829:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:10258:x1868797312003328:12345-192.168.202.7@tcp:35:bash.0 Request processed in 391us (4327us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1782224273.775837:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:3.0:1782224273.833814:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224273.833883:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312003584 00000100:00100000:2.0:1782224273.833895:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312003584 00000100:00100000:2.0:1782224273.833971:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 41 00000100:00100000:2.0:1782224273.833981:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:10268:x1868797312003584:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1782224273.834055:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224273.834077:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b164c2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a515bc expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224273.834187:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1782224273.834302:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b164c2f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515bc expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.834692:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fd00) 00010000:00010000:2.0:1782224273.834697:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782224273.834704:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b164c2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515bc expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.834720:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaa600, rc 0) 00000100:00100000:2.0:1782224273.834787:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+14:10268:x1868797312003584:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 806us (979us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1782224273.834795:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 41 00000100:00100000:3.0:1782224273.841730:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224273.841859:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312003840 00000100:00100000:2.0:1782224273.841869:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312003840 00000100:00100000:2.0:1782224273.841931:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:2.0:1782224273.841942:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+14:10268:x1868797312003840:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:2.0:1782224273.842665:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+15:10268:x1868797312003840:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 710us (931us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1782224273.842675:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:0.0:1782224273.929385:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224273.929449:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312003968 00000100:00100000:2.0:1782224273.929460:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312003968 00000100:00100000:2.0:1782224273.929531:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 42 00000100:00100000:2.0:1782224273.929556:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+15:10274:x1868797312003968:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1782224273.929582:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224273.929604:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b164c3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a515c3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.929683:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b164c44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.929699:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b164c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.929714:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b164c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224273.929778:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1782224273.929781:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224273.929804:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b164c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.929829:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b164c3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515c3 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.929861:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b164c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515c3 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.929870:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:2.0:1782224273.929873:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782224273.929876:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab800, rc 0) 00000100:00100000:2.0:1782224273.929940:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+16:10274:x1868797312003968:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 387us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224273.929956:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 42 00000100:00100000:3.0:1782224273.934877:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224273.934986:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312004224 00000100:00100000:2.0:1782224273.936767:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312004224 00000100:00100000:2.0:1782224273.936851:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00100000:2.0:1782224273.936862:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+16:10274:x1868797312004224:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1782224273.936884:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224273.936905:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b164c4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a515ca expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.937037:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b164c52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.937052:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b164c52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.937065:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b164c52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224273.937075:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1782224273.937246:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b164c4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515ca expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.937264:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b164c52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515ca expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.937272:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508f900) 00010000:00010000:2.0:1782224273.937275:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782224273.937278:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab400, rc 0) 00000100:00100000:2.0:1782224273.937573:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:10274:x1868797312004224:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 711us (2704us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1782224273.937581:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00100000:3.0:1782224273.943765:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224273.946832:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224273.946911:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312004608 00000100:00100000:2.0:1782224273.946920:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312004608 00000100:00100000:2.0:1782224273.946974:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:2.0:1782224273.946993:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83517100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:2346:x1868797312004608:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782224273.947010:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224273.947066:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b164c52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515ca expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.947083:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508f900) 00010000:00010000:2.0:1782224273.947088:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224273.947148:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83517100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+17:2346:x1868797312004608:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 157us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224273.947157:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:0.0:1782224273.947738:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312004480 00000100:00100000:0.0:1782224273.947759:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312004480 00000100:00100000:0.0:1782224273.948230:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 44 00000100:00100000:0.0:1782224273.948241:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+17:10274:x1868797312004480:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1782224273.948264:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224273.948280:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164c60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a515d1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224273.949740:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b164c67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224273.949765:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b164c67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224273.949779:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b164c67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224273.949796:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1782224273.949957:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164c60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515d1 expref: 20 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224273.949976:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b164c67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515d1 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224273.950251:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508f900) 00010000:00010000:0.0:1782224273.950254:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782224273.950258:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74c00, rc 0) 00000100:00100000:0.0:1782224273.950403:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+19:10274:x1868797312004480:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 2163us (6646us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1782224273.950413:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 44 00000100:00100000:1.0:1782224273.959215:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224273.959345:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312004736 00000100:00100000:2.0:1782224273.959414:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312004736 00000100:00100000:2.0:1782224273.959503:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:2.0:1782224273.959514:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2347:x1868797312004736:12345-192.168.202.7@tcp:1:lfs.0 00010000:00010000:2.0:1782224273.959566:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b164c75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.959586:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afa46d54/0xcfd8b3ae4b164c28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515b5 expref: 7 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.959595:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782224273.959612:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782224273.959617:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b164c75 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.959651:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000afa46d54/0xcfd8b3ae4b164c28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515b5 expref: 7 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.959671:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000afa46d54/0xcfd8b3ae4b164c28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515b5 expref: 7 pid: 6715 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224273.959683:0:6584:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6584:1868797333011712:192.168.202.7@tcp:104: 00000100:00100000:2.0:1782224273.959759:0:6584:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa7d49e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782224273.963570:0:6584:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6584:1868797333011712:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224273.963601:0:6584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b164c75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224273.965524:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224273.965643:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312004864 00000100:00100000:2.0:1782224273.965651:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312004864 00002000:00100000:2.0:1782224273.965712:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff96eabf5a3b80 x1868797312004864/t0(0) o4->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:729/0 lens 504/0 e 0 to 0 dl 1782224284 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782224273.965724:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96eabf5a3b80 with x1868797312004864 ext(0->12) 00010000:00010000:2.0:1782224273.965732:0:6588:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000afa46d54/0xcfd8b3ae4b164c28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515b5 expref: 8 pid: 6715 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224273.965749:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000afa46d54/0xcfd8b3ae4b164c28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515b5 expref: 8 pid: 6715 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782224273.965775:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff96eabf5a3b80 00000100:00100000:2.0:1782224273.965813:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:2.0:1782224273.965822:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2347:x1868797312004864:12345-192.168.202.7@tcp:4:lfs.0 00000001:00100000:3.0:1782224274.024944:0:6608:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 00000100:00100000:2.0:1782224274.026719:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:2347:x1868797312004864:12345-192.168.202.7@tcp:4:lfs.0 Request processed in 60883us (61197us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1782224274.026734:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 0 00002000:00100000:2.0:1782224274.026799:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff96eabf5a3b80 x1868797312004864/t4294967299(0) o4->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:729/0 lens 504/448 e 0 to 0 dl 1782224284 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782224274.026811:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96eabf5a3b80 with x1868797312004864 ext(0->12) 00010000:00010000:2.0:1782224274.026822:0:6588:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000afa46d54/0xcfd8b3ae4b164c28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515b5 expref: 9 pid: 6715 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.026841:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000afa46d54/0xcfd8b3ae4b164c28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515b5 expref: 9 pid: 6715 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782224274.026850:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff96eabf5a3b80 00000100:00100000:3.0:1782224274.031280:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224274.031360:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312004992 00000100:00100000:2.0:1782224274.031371:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312004992 00010000:00010000:2.0:1782224274.031411:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000afa46d54/0xcfd8b3ae4b164c28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515b5 expref: 9 pid: 6715 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224274.031459:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00100000:2.0:1782224274.031469:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:2346:x1868797312004992:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782224274.031500:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1782224274.031528:0:5772:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1782224274.031532:0:5772:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1782224273 00002000:00010000:2.0:1782224274.031534:0:5772:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1782224273 00002000:00010000:2.0:1782224274.031543:0:5772:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1782224273 00010000:00010000:2.0:1782224274.031550:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000afa46d54/0xcfd8b3ae4b164c28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515b5 expref: 9 pid: 6715 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.031563:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000afa46d54/0xcfd8b3ae4b164c28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515b5 expref: 9 pid: 6715 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.031588:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afa46d54/0xcfd8b3ae4b164c28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515b5 expref: 9 pid: 6715 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.031603:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782224274.031606:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782224274.031611:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b164c75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.031620:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b164c75 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.031660:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224274.031725:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2346:x1868797312004992:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 248us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224274.031731:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 36 00010000:00010000:0.0:1782224274.031893:0:6584:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b164c75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.031903:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b164c75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.031928:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b164c75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.031936:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b164c75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.031944:0:6584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b164c75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.031951:0:6584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224274.031955:0:6584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b164c75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.031964:0:6584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b164c75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.031978:0:6584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b164c75 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.031984:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b164c75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224274.032073:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2347:x1868797312004736:12345-192.168.202.7@tcp:1:lfs.0 Request processed in 72561us (72866us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224274.032095:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:2.0:1782224274.038908:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224274.039451:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312005248 00000100:00100000:1.0:1782224274.039461:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312005248 00000100:00100000:1.0:1782224274.039963:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:1.0:1782224274.040652:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+19:10274:x1868797312005248:12345-192.168.202.7@tcp:35:lfs.0 00000004:00010000:1.0:1782224274.040844:0:5790:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b164c67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515d1 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782224274.041929:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1782224274.042383:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1782224274.045164:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1782224274.045275:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164c7c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.045299:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164c0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515a7 expref: 23 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.045308:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164c7c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.045346:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515a7 expref: 23 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.045362:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164c0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515a7 expref: 23 pid: 6605 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224274.045376:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83360a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5790:1868797333011840:192.168.202.7@tcp:104: 00000100:00100000:0.0:1782224274.045472:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabb9bd600 going to sleep for 11 seconds 00000100:00100000:2.0:1782224274.056439:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224274.056967:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312005376 00000100:00100000:3.0:1782224274.056976:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312005376 00010000:00010000:3.0:1782224274.057035:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164c0c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515a7 expref: 24 pid: 6605 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224274.057099:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00100000:3.0:1782224274.057109:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+24:2346:x1868797312005376:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224274.057124:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224274.057143:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164c0c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515a7 expref: 24 pid: 6605 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.057156:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164c0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515a7 expref: 24 pid: 6605 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.057189:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508f900) 00010000:00010000:3.0:1782224274.057194:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164c7c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.057204:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164c7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.057211:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164c7c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.057228:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224274.057285:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+24:2346:x1868797312005376:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 177us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224274.057293:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 37 00010000:00010000:0.0:1782224274.060064:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164c0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515a7 expref: 23 pid: 6605 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224274.060473:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83360a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5790:1868797333011840:192.168.202.7@tcp:104: 00010000:00010000:0.0:1782224274.060528:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164c7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.060665:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164c7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.060673:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164c7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782224274.060920:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1782224274.061496:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1782224274.061882:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83360a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1868797333011968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782224274.061954:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224274.062052:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabb9bd480 going to sleep for 11 seconds 00000100:00100000:2.0:1782224274.063065:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333011968 00000100:00100000:2.0:1782224274.063074:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333011968 00000100:00100000:2.0:1782224274.063158:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782224274.063179:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5790:x1868797333011968:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782224274.063279:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5790:x1868797333011968:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 111us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224274.063287:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782224274.063336:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83360a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1868797333011968:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1782224274.065355:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1782224274.066890:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1782224274.067395:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83f52a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1868797333012096:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782224274.067483:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224274.067524:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa1387b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782224274.067837:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333012096 00000100:00100000:0.0:1782224274.067845:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333012096 00000100:00100000:0.0:1782224274.067904:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782224274.067914:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5790:x1868797333012096:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782224274.068458:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5790:x1868797333012096:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 544us (973us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1782224274.068467:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782224274.070430:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83f52a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1868797333012096:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1782224274.071477:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1782224274.071689:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164c7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.071702:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164c7c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.071711:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164c7c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.071887:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224274.071893:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164c7c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.071918:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164c7c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.071935:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508f900) 00010000:00010000:2.0:1782224274.071938:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1782224274.071942:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164c7c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.071949:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164c7c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782224274.072894:0:5790:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1782224274.073491:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1782224274.073505:0:5790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354853489357ns, next at 355853486568ns, rc = 0 00000001:00080000:2.0:1782224274.073702:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1782224274.073886:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508f900) 00010000:00010000:2.0:1782224274.073891:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782224274.073901:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b164c67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515d1 expref: 27 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224274.074424:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+26:10274:x1868797312005248:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 34448us (35522us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1782224274.074435:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 8 00000020:00080000:2.0:1782224274.074442:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1782224274.081439:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224274.081662:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312005504 00000100:00100000:0.0:1782224274.081673:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312005504 00000100:00100000:0.0:1782224274.081884:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:0.0:1782224274.081897:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+26:10274:x1868797312005504:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1782224274.081921:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224274.081945:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b164c83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a515d8 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.082066:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b164c83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515d8 expref: 27 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.082346:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b164c83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515d8 expref: 27 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.082368:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:0.0:1782224274.082373:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782224274.082376:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a75000, rc 0) 00000100:00100000:0.0:1782224274.082491:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+27:10274:x1868797312005504:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 597us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224274.082499:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:2.0:1782224274.088358:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224274.089516:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312005760 00000100:00100000:3.0:1782224274.089530:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312005760 00000100:00100000:3.0:1782224274.089729:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:3.0:1782224274.089748:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea9c492850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+27:10274:x1868797312005760:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1782224274.090054:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea9c492850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+28:10274:x1868797312005760:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 315us (1705us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1782224274.090061:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00010000:00010000:1.0:1782224274.134220:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224274.216620:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224274.220093:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312006016 00000100:00100000:1.0:1782224274.220107:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312006016 00000100:00100000:1.0:1782224274.220173:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00100000:1.0:1782224274.220184:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+28:10284:x1868797312006016:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1782224274.220226:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224274.220247:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164c8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a515df expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224274.220363:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1782224274.220503:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164c8a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515df expref: 30 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.220519:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fd00) 00010000:00010000:1.0:1782224274.220522:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782224274.220528:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164c8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515df expref: 30 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.220547:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99877a00, rc 0) 00000100:00100000:1.0:1782224274.220810:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+29:10284:x1868797312006016:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 626us (4197us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1782224274.220819:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00100000:0.0:1782224274.229874:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224274.230078:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312006144 00000100:00100000:2.0:1782224274.230101:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312006144 00000100:00100000:2.0:1782224274.230157:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00100000:2.0:1782224274.230318:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+29:10284:x1868797312006144:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:2.0:1782224274.230414:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164c98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230431:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164c98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230445:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164c98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230461:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164c9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230469:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230475:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230708:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b164ca6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230719:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b164ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230727:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b164ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782224274.230772:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b164ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230797:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164c98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230804:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164c98 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230812:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164c98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230818:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224274.230822:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164c98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230830:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164c98 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230843:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:2.0:1782224274.230846:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224274.230852:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164c98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230858:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164c98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230872:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230879:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164c9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230885:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164c9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230897:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224274.230900:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164c9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230907:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164c9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230916:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96ea8635f600) 00010000:00010000:2.0:1782224274.230919:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224274.230921:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164c9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230927:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164c9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230943:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b164ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230950:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b164ca6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230955:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b164ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230960:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaac00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224274.230962:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b164ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230968:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b164ca6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230985:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:2.0:1782224274.230987:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224274.230990:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b164ca6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.230996:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b164ca6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224274.231142:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+29:10284:x1868797312006144:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 975us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224274.231153:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00100000:2.0:1782224274.236631:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224274.236775:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312006400 00000100:00100000:3.0:1782224274.236786:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312006400 00000100:00100000:3.0:1782224274.236859:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:3.0:1782224274.236870:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+29:10284:x1868797312006400:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1782224274.237163:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+30:10284:x1868797312006400:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 293us (541us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1782224274.237171:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:3.0:1782224274.298993:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224274.299182:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312006656 00000100:00100000:1.0:1782224274.299193:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312006656 00000100:00100000:1.0:1782224274.299289:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:1.0:1782224274.299302:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+30:10287:x1868797312006656:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1782224274.299325:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224274.299345:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164cad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a515e6 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299419:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164cb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299451:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299463:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299478:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164cbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299485:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299492:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299618:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164cc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299628:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299635:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224274.299644:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1782224274.299755:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299764:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164cb4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299771:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164cb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299783:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224274.299787:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164cb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299794:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164cb4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299806:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:1.0:1782224274.299809:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224274.299814:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164cb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299820:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164cb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299833:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299839:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164cbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299844:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164cbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299848:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224274.299851:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164cbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299856:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164cbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299873:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96ea8508f700) 00010000:00010000:1.0:1782224274.299876:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224274.299878:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164cbb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299883:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164cbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299924:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164cad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515e6 expref: 33 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299938:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515e6 expref: 32 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.299945:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:1.0:1782224274.299947:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782224274.299949:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99876c00, rc 0) 00000100:00100000:1.0:1782224274.300083:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+32:10287:x1868797312006656:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 783us (1105us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1782224274.300090:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:0.0:1782224274.303827:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224274.304294:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312006784 00000100:00100000:2.0:1782224274.304305:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312006784 00000100:00100000:2.0:1782224274.304371:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:2.0:1782224274.304382:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+32:10287:x1868797312006784:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:2.0:1782224274.304683:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164cd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.304703:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.304716:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.304744:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.304751:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164cd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.304771:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.304777:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224274.304782:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.304790:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164cd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.304803:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:2.0:1782224274.304807:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782224274.304812:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164cd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.304818:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164cd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224274.304913:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+32:10287:x1868797312006784:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 532us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224274.304921:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:2.0:1782224274.311308:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224274.311532:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312007040 00000100:00100000:3.0:1782224274.311541:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312007040 00000100:00100000:3.0:1782224274.311678:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:3.0:1782224274.311689:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+32:10287:x1868797312007040:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1782224274.312965:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+33:10287:x1868797312007040:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 1270us (1658us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1782224274.312985:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:3.0:1782224274.575684:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224274.577507:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312007296 00000100:00100000:0.0:1782224274.577522:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312007296 00000100:00100000:0.0:1782224274.577602:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 50 00000100:00100000:0.0:1782224274.577614:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+33:10318:x1868797312007296:12345-192.168.202.7@tcp:101:cat.0 00010000:00010000:0.0:1782224274.577644:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224274.577677:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164cd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a515ed expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.577790:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b164cde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.577806:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b164cde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.577833:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b164cde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224274.577845:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1782224274.577996:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164cd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515ed expref: 36 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.578116:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b164cde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515ed expref: 35 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224274.578127:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:0.0:1782224274.578130:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782224274.578134:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74c00, rc 0) 00000100:00100000:0.0:1782224274.578872:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+35:10318:x1868797312007296:12345-192.168.202.7@tcp:101:cat.0 Request processed in 605us (2576us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1782224274.578883:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 50 00000100:00100000:0.0:1782224274.586981:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224274.587246:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312007552 00000100:00100000:1.0:1782224274.587256:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312007552 00000100:00100000:1.0:1782224274.587322:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:1.0:1782224274.587333:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+35:10318:x1868797312007552:12345-192.168.202.7@tcp:35:cat.0 00000100:00100000:1.0:1782224274.587578:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+36:10318:x1868797312007552:12345-192.168.202.7@tcp:35:cat.0 Request processed in 246us (607us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1782224274.587586:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:0.0:1782224274.590963:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224274.591169:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312007680 00000100:00100000:1.0:1782224274.591178:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312007680 00000100:00100000:1.0:1782224274.591255:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:1.0:1782224274.591267:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea860b2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+36:2346:x1868797312007680:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782224274.591286:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224274.591309:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b164cde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515ed expref: 36 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.591325:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:1.0:1782224274.591330:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224274.591389:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea860b2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+35:2346:x1868797312007680:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 124us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224274.591395:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:0.0:1782224274.668530:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224274.668615:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312007936 00000100:00100000:3.0:1782224274.668626:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312007936 00000100:00100000:3.0:1782224274.668712:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:3.0:1782224274.668723:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+35:10324:x1868797312007936:12345-192.168.202.7@tcp:101:dd.0 00010000:00010000:3.0:1782224274.668752:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224274.668756:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782224274.668783:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b164c44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515c3 expref: 35 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.668803:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:3.0:1782224274.668808:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782224274.668820:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164cec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a515f4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.668924:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164cf3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.668939:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164cc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515e6 expref: 35 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.668946:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164cf3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.669172:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515e6 expref: 35 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.669189:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164cc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515e6 expref: 35 pid: 6605 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224274.669205:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83514000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333012224:192.168.202.7@tcp:104: 00000100:00100000:3.0:1782224274.669312:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa7a0f180 going to sleep for 11 seconds 00000100:00100000:3.0:1782224274.675533:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83514000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333012224:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224274.675566:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164cf3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224274.675771:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224274.675991:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312008064 00000100:00100000:3.0:1782224274.675999:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312008064 00010000:00010000:3.0:1782224274.676065:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164cc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515e6 expref: 36 pid: 6605 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224274.676093:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 38 00000100:00100000:3.0:1782224274.676114:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+36:2346:x1868797312008064:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224274.676131:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224274.676138:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164cc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515e6 expref: 36 pid: 6605 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.676150:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515e6 expref: 36 pid: 6605 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.676233:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164cc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515e6 expref: 36 pid: 6605 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.676249:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:3.0:1782224274.676253:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164cf3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.676263:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164cf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.676271:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164cf3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.676302:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224274.676349:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164cf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224274.676356:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+35:2346:x1868797312008064:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 241us (583us total) trans 0 rc 0/0 00010000:00010000:2.0:1782224274.676364:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164cf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224274.676369:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 38 00000004:00200000:2.0:1782224274.676393:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1782224274.676568:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164cec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515f4 expref: 36 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.676597:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164cf3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515f4 expref: 35 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.676605:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:2.0:1782224274.676608:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782224274.676610:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674200, rc 0) 00000100:00100000:2.0:1782224274.676638:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+35:10324:x1868797312007936:12345-192.168.202.7@tcp:101:dd.0 Request processed in 7917us (8116us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1782224274.676645:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:0.0:1782224274.681583:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224274.681677:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312008320 00000100:00100000:1.0:1782224274.681686:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312008320 00000100:00100000:1.0:1782224274.681736:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 52 00000100:00100000:1.0:1782224274.681744:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+35:10324:x1868797312008320:12345-192.168.202.7@tcp:36:dd.0 00010000:00010000:1.0:1782224274.681984:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164d01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.681999:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.682009:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782224274.682391:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1782224274.682410:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004e2575a8 reply state 0000000008df33dd transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224274.682433:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782224274.682506:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+38:10324:x1868797312008320:12345-192.168.202.7@tcp:36:dd.0 Request processed in 762us (934us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1782224274.682514:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 52 00000020:00080000:1.0:1782224274.682519:0:6605:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782224274.688240:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.688258:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164d01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.688284:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164d01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.688290:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224274.688295:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164d01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.688304:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164d01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.688322:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:3.0:1782224274.688326:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224274.688331:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164d01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224274.688337:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164d01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224274.851787:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224274.851935:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312008448 00000100:00100000:2.0:1782224274.851948:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312008448 00000100:00100000:2.0:1782224274.852053:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:2.0:1782224274.852065:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+37:10338:x1868797312008448:12345-192.168.202.7@tcp:101:stat.0 00010000:00010000:2.0:1782224274.852097:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224274.852121:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164d08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a515fb expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.852201:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164d0f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.852218:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164d0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.852230:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164d0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.852263:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164d16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.852288:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.852295:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.852411:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164d1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.852424:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164cf3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515f4 expref: 38 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.852433:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164d1d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.852472:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164cf3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515f4 expref: 38 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.852487:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164cf3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515f4 expref: 38 pid: 5788 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224274.852517:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eac1d8ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1868797333012352:192.168.202.7@tcp:104: 00000100:00100000:2.0:1782224274.852624:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea9055f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224274.859141:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224274.859318:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eac1d8ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1868797333012352:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224274.859350:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164d1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224274.859427:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312008704 00000100:00100000:1.0:1782224274.859436:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312008704 00000100:00100000:1.0:1782224274.859522:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:1.0:1782224274.859535:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+39:5563:x1868797312008704:12345-192.168.202.7@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1782224274.860723:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+40:5563:x1868797312008704:12345-192.168.202.7@tcp:35:ldlm_bl.0 Request processed in 1186us (1588us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1782224274.860734:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:0.0:1782224274.863221:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224274.863381:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312008832 00000100:00100000:1.0:1782224274.863391:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312008832 00010000:00010000:1.0:1782224274.863436:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164cf3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515f4 expref: 40 pid: 5788 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224274.863532:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:1.0:1782224274.863543:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+40:2346:x1868797312008832:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782224274.863563:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224274.863571:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164cf3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515f4 expref: 40 pid: 5788 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.863585:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164cf3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515f4 expref: 40 pid: 5788 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.863632:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164cf3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515f4 expref: 40 pid: 5788 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.863668:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:1.0:1782224274.863674:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164d1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.863684:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.863692:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164d1d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.863729:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224274.863793:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+39:2346:x1868797312008832:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 252us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224274.863802:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 39 00010000:00010000:2.0:1782224274.863873:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.863890:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224274.863942:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1782224274.863947:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224274.863988:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.864001:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.864051:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164d0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.864059:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164d0f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.864067:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164d0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.864073:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224274.864077:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164d0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.864085:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164d0f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.864094:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:2.0:1782224274.864097:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224274.864101:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164d0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.864118:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b164d0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.864132:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.864138:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164d16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.864144:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164d16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.864148:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaaa00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224274.864152:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164d16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.864158:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164d16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.864181:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96ea8635f600) 00010000:00010000:2.0:1782224274.864184:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224274.864187:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164d16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.864193:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164d16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.864232:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164d08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515fb expref: 39 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.864247:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164d1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515fb expref: 38 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.864261:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:2.0:1782224274.864264:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782224274.864267:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab600, rc 0) 00000100:00100000:2.0:1782224274.864314:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+38:10338:x1868797312008448:12345-192.168.202.7@tcp:101:stat.0 Request processed in 12239us (12526us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224274.864323:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:0.0:1782224274.908194:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224274.908354:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312009088 00000100:00100000:2.0:1782224274.908365:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312009088 00000100:00100000:2.0:1782224274.908416:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 54 00000100:00100000:2.0:1782224274.908427:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+38:10344:x1868797312009088:12345-192.168.202.7@tcp:36:truncate.0 00010000:00010000:2.0:1782224274.908507:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224274.908533:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164d1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515fb expref: 38 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.908553:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:2.0:1782224274.908558:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224274.909352:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164d24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.909369:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164d24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224274.909379:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164d24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782224274.909428:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1782224274.909444:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002d7ca7b1 reply state 0000000060b41005 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164d24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224274.909456:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782224274.909568:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+40:10344:x1868797312009088:12345-192.168.202.7@tcp:36:truncate.0 Request processed in 1142us (1382us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1782224274.909575:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 54 00000020:00080000:2.0:1782224274.909579:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782224274.918264:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164d24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.918284:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164d24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.918292:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164d24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.918298:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224274.918302:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164d24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.918328:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164d24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.918347:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:1.0:1782224274.918350:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224274.918354:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164d24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224274.918359:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164d24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224275.018779:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224275.018951:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312009216 00000100:00100000:3.0:1782224275.018960:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312009216 00000100:00100000:3.0:1782224275.019076:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 55 00000100:00100000:3.0:1782224275.019085:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+39:10358:x1868797312009216:12345-192.168.202.7@tcp:101:stat.0 00010000:00010000:3.0:1782224275.019107:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224275.019124:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164d2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51602 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019182:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d32 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019196:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019225:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019237:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019241:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019245:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019322:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019327:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019331:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224275.019362:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1782224275.019364:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782224275.019383:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019390:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019396:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019406:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d32 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019411:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019414:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224275.019417:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019422:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d32 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019430:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:3.0:1782224275.019432:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224275.019435:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019439:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019451:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019454:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019458:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019460:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224275.019465:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019469:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019473:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96ea87df7a00) 00010000:00010000:3.0:1782224275.019476:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224275.019478:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019483:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019515:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164d2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51602 expref: 41 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019528:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51602 expref: 40 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.019535:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:3.0:1782224275.019537:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782224275.019538:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674400, rc 0) 00000100:00080000:0.0:1782224275.019675:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224275.019692:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+40:10358:x1868797312009216:12345-192.168.202.7@tcp:101:stat.0 Request processed in 608us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224275.019700:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 55 00000100:00100000:0.0:1782224275.086525:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224275.086654:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312009472 00000100:00100000:1.0:1782224275.086665:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312009472 00000100:00100000:1.0:1782224275.086732:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 56 00000100:00100000:1.0:1782224275.086742:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+40:10368:x1868797312009472:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1782224275.086763:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224275.086785:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164d47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51609 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224275.086900:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1782224275.087073:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164d47 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51609 expref: 42 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224275.087088:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fd00) 00010000:00010000:1.0:1782224275.087091:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782224275.087096:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164d47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51609 expref: 42 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224275.087131:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99877c00, rc 0) 00000100:00100000:1.0:1782224275.087204:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+41:10368:x1868797312009472:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 463us (689us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1782224275.087212:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 56 00000100:00100000:1.0:1782224275.090352:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224275.090435:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312009728 00000100:00100000:3.0:1782224275.090444:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312009728 00000100:00100000:3.0:1782224275.090497:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:3.0:1782224275.090508:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+41:10368:x1868797312009728:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1782224275.090797:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+42:10368:x1868797312009728:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 290us (454us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1782224275.090805:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:0.0:1782224275.141855:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224275.141973:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312009984 00000100:00100000:3.0:1782224275.141983:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312009984 00000100:00100000:3.0:1782224275.142060:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 57 00000100:00100000:3.0:1782224275.142068:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+42:10374:x1868797312009984:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:3.0:1782224275.142089:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224275.142105:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164d55 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51610 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.142201:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d5c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.142212:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51602 expref: 43 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.142218:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d5c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.142243:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51602 expref: 43 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.142252:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51602 expref: 43 pid: 5788 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224275.142261:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83514000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333012480:192.168.202.7@tcp:104: 00000100:00100000:3.0:1782224275.142363:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa7a0f180 going to sleep for 11 seconds 00000100:00100000:2.0:1782224275.145762:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224275.145881:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312010112 00000100:00100000:0.0:1782224275.145889:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312010112 00010000:00010000:0.0:1782224275.145924:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d40 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51602 expref: 44 pid: 5788 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224275.145960:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 40 00000100:00100000:0.0:1782224275.145974:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+44:2347:x1868797312010112:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224275.145988:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224275.145993:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d40 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51602 expref: 44 pid: 5788 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.146003:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51602 expref: 44 pid: 5788 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.146061:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:0.0:1782224275.146066:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d5c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.146076:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.146084:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d5c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.146100:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224275.146149:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+44:2347:x1868797312010112:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 182us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224275.146154:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 40 00010000:00010000:3.0:1782224275.146851:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51602 expref: 43 pid: 5788 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224275.146876:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83514000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333012480:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224275.146899:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.146908:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.146913:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224275.146935:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1782224275.147188:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164d55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51610 expref: 44 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.147204:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51610 expref: 43 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.147212:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:3.0:1782224275.147214:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782224275.147216:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675a00, rc 0) 00000100:00100000:3.0:1782224275.147263:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+43:10374:x1868797312009984:12345-192.168.202.7@tcp:101:bash.0 Request processed in 5194us (5414us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1782224275.147271:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 57 00000100:00100000:2.0:1782224275.149279:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224275.149407:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312010368 00000100:00100000:0.0:1782224275.149416:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312010368 00000100:00100000:0.0:1782224275.149464:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 58 00000100:00100000:0.0:1782224275.149539:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+43:10374:x1868797312010368:12345-192.168.202.7@tcp:36:bash.0 00010000:00010000:0.0:1782224275.149787:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164d6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.149853:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164d6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.149862:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164d6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782224275.149903:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1782224275.149919:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002b1e6839 reply state 0000000091a32270 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164d6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224275.149925:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782224275.150148:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+46:10374:x1868797312010368:12345-192.168.202.7@tcp:36:bash.0 Request processed in 674us (876us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1782224275.150156:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 58 00000020:00080000:0.0:1782224275.150161:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782224275.152986:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164d6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.153052:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164d6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.153060:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164d6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.153067:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224275.153072:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164d6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.153080:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164d6a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.153097:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:3.0:1782224275.153100:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224275.153105:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164d6a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.153111:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b164d6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224275.154529:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224275.154695:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312010496 00000100:00100000:0.0:1782224275.154706:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312010496 00000100:00100000:0.0:1782224275.154770:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 59 00000100:00100000:0.0:1782224275.154780:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+45:10374:x1868797312010496:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:0.0:1782224275.154805:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224275.154825:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b164d71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51617 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.154928:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164d78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.154943:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d5c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51610 expref: 46 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.154953:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164d78 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.158775:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51610 expref: 46 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.158800:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d5c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51610 expref: 46 pid: 5788 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224275.158818:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabbbde300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1868797333012608:192.168.202.7@tcp:104: 00000100:00100000:0.0:1782224275.158916:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabb9bdb40 going to sleep for 11 seconds 00010000:00010000:2.0:1782224275.159108:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224275.160938:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224275.161206:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312010624 00000100:00100000:3.0:1782224275.161216:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312010624 00010000:00010000:3.0:1782224275.161261:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d5c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51610 expref: 47 pid: 5788 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224275.161291:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 41 00000100:00100000:3.0:1782224275.161301:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+47:2347:x1868797312010624:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224275.161316:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224275.161341:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d5c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51610 expref: 47 pid: 5788 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.161354:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d5c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51610 expref: 47 pid: 5788 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.161375:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:3.0:1782224275.161380:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164d78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.161383:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164d5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51610 expref: 47 pid: 5788 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.161388:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.161395:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164d78 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224275.161402:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabbbde300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1868797333012608:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224275.161410:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782224275.161425:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.161433:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.161447:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224275.161460:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+46:2347:x1868797312010624:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 160us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224275.161467:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 41 00000004:00200000:0.0:1782224275.162252:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1782224275.162258:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782224275.162282:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.162311:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b164d71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51617 expref: 46 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.162323:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164d78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51617 expref: 45 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.162328:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:0.0:1782224275.162330:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782224275.162332:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74600, rc 0) 00000100:00100000:0.0:1782224275.162365:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+45:10374:x1868797312010496:12345-192.168.202.7@tcp:101:bash.0 Request processed in 7587us (7898us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224275.162371:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 59 00000100:00100000:2.0:1782224275.165411:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224275.165544:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312010880 00000100:00100000:3.0:1782224275.165553:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312010880 00000100:00100000:3.0:1782224275.165600:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:3.0:1782224275.165610:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea9c493050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+45:10374:x1868797312010880:12345-192.168.202.7@tcp:35:bash.0 00000100:00100000:3.0:1782224275.166190:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea9c493050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+46:10374:x1868797312010880:12345-192.168.202.7@tcp:35:bash.0 Request processed in 578us (787us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1782224275.166200:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:1.0:1782224275.221368:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224275.221474:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312011136 00000100:00100000:2.0:1782224275.221486:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312011136 00000100:00100000:2.0:1782224275.221560:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 60 00000100:00100000:2.0:1782224275.221570:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+46:10384:x1868797312011136:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1782224275.221594:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224275.221615:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164d7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5161e expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224275.221740:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1782224275.221853:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164d7f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5161e expref: 48 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.221867:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fd00) 00010000:00010000:2.0:1782224275.221871:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782224275.221876:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b164d7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5161e expref: 48 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.221913:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaaa00, rc 0) 00000100:00100000:2.0:1782224275.222077:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+47:10384:x1868797312011136:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 507us (718us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1782224275.222086:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 60 00000100:00100000:2.0:1782224275.224711:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224275.224764:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312011264 00000100:00100000:3.0:1782224275.224775:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312011264 00000100:00100000:3.0:1782224275.224893:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00100000:3.0:1782224275.224903:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+47:10384:x1868797312011264:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:3.0:1782224275.224985:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164d8d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225001:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164d8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225011:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164d8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225053:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225060:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225068:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225174:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225183:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225189:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782224275.225231:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225243:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164d8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225253:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164d8d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225258:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164d8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225261:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224275.225264:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164d8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225269:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164d8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225278:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:3.0:1782224275.225280:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224275.225283:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164d8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225287:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164d8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225298:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225301:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225304:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225308:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224275.225313:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225317:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225321:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96ea87df7a00) 00010000:00010000:3.0:1782224275.225322:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224275.225323:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225326:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164d94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225335:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225339:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225342:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225344:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224275.225346:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225349:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225353:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:3.0:1782224275.225354:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224275.225359:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.225362:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164d9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224275.225420:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+47:10384:x1868797312011264:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 518us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224275.225428:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00100000:3.0:1782224275.226871:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224275.227252:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312011520 00000100:00100000:1.0:1782224275.227259:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312011520 00000100:00100000:1.0:1782224275.227322:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:1.0:1782224275.227330:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+47:10384:x1868797312011520:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:1.0:1782224275.227531:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+48:10384:x1868797312011520:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 201us (666us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1782224275.227536:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:1.0:1782224275.247750:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224275.247863:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312011776 00000100:00100000:2.0:1782224275.247872:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312011776 00000100:00100000:2.0:1782224275.247964:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 62 00000100:00100000:2.0:1782224275.247980:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+48:10387:x1868797312011776:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1782224275.248001:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224275.248056:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164da2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51625 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248137:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164da9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248152:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164da9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248171:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164da9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248184:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b164db0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248189:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b164db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248209:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b164db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248310:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b164db7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248315:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b164db7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248320:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b164db7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224275.248328:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1782224275.248404:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164da9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248409:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164da9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248413:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164da9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248417:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224275.248420:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164da9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248424:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164da9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248433:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:2.0:1782224275.248435:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224275.248442:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164da9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248446:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164da9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248454:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b164db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248458:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b164db0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248462:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b164db0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248464:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224275.248466:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b164db0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248469:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b164db0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248473:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96ea8635f600) 00010000:00010000:2.0:1782224275.248474:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224275.248476:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b164db0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248478:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b164db0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248508:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b164da2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51625 expref: 51 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248524:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b164db7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51625 expref: 50 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224275.248529:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:2.0:1782224275.248530:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782224275.248532:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaac00, rc 0) 00000100:00100000:2.0:1782224275.248583:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+50:10387:x1868797312011776:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 604us (841us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1782224275.248590:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 62 00000100:00100000:2.0:1782224275.250874:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224275.251153:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312011904 00000100:00100000:0.0:1782224275.251164:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312011904 00000100:00100000:0.0:1782224275.251222:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:0.0:1782224275.251233:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+50:2346:x1868797312011904:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224275.251249:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224275.251273:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b164db7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51625 expref: 50 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.251312:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:0.0:1782224275.251317:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224275.251414:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+49:2346:x1868797312011904:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 182us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224275.251422:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:3.0:1782224275.253169:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224275.253209:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312012032 00000100:00100000:0.0:1782224275.253220:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312012032 00000100:00100000:0.0:1782224275.253279:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 63 00000100:00100000:0.0:1782224275.253290:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+49:10387:x1868797312012032:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:0.0:1782224275.253361:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b164dc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.253377:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b164dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.253390:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b164dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.253419:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b164dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.253426:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b164dc5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.253433:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b164dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.253438:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224275.253444:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b164dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.253464:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b164dc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.253475:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:0.0:1782224275.253477:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782224275.253482:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b164dc5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.253488:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b164dc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224275.253561:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+49:10387:x1868797312012032:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 273us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224275.253569:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 63 00000100:00100000:2.0:1782224275.255211:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224275.255260:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312012288 00000100:00100000:3.0:1782224275.255268:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312012288 00000100:00100000:3.0:1782224275.255312:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:3.0:1782224275.255322:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+49:10387:x1868797312012288:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1782224275.255510:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+50:10387:x1868797312012288:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 189us (308us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1782224275.255518:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:2.0:1782224275.347267:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224275.347448:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312012544 00000100:00100000:0.0:1782224275.347460:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312012544 00000100:00100000:0.0:1782224275.347518:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00100000:0.0:1782224275.347529:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+50:10405:x1868797312012544:12345-192.168.202.7@tcp:101:cat.0 00010000:00010000:0.0:1782224275.347887:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224275.347981:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b164dcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5162c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.348150:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b164dd3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.348167:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b164dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.348230:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b164dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224275.348258:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1782224275.348511:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b164dcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5162c expref: 53 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.348530:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b164dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5162c expref: 52 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224275.348539:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:0.0:1782224275.348541:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782224275.348545:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a75200, rc 0) 00000100:00100000:0.0:1782224275.348707:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:10405:x1868797312012544:12345-192.168.202.7@tcp:101:cat.0 Request processed in 1179us (1446us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1782224275.348714:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00100000:2.0:1782224275.363815:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224275.363882:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312012672 00000100:00100000:3.0:1782224275.363891:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312012672 00000100:00100000:3.0:1782224275.363947:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 65 00000100:00100000:3.0:1782224275.363954:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:10406:x1868797312012672:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1782224275.363976:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224275.363996:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164de1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51633 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.364103:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164de8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.364135:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.364147:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224275.364337:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1782224275.364342:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782224275.364364:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.364390:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164de1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51633 expref: 54 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.364409:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164de8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51633 expref: 53 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.364416:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:3.0:1782224275.364417:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782224275.364419:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674400, rc 0) 00000100:00100000:3.0:1782224275.364468:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+53:10406:x1868797312012672:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 515us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224275.364473:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 65 00000100:00100000:2.0:1782224275.367375:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224275.367427:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312013056 00000100:00100000:1.0:1782224275.367436:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312013056 00000100:00100000:1.0:1782224275.367480:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:1.0:1782224275.367487:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+53:10406:x1868797312013056:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:1.0:1782224275.367797:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:10406:x1868797312013056:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 309us (428us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1782224275.367804:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:2.0:1782224275.369110:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224275.369152:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312013184 00000100:00100000:3.0:1782224275.369170:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312013184 00000100:00100000:3.0:1782224275.369228:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:3.0:1782224275.369235:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:10406:x1868797312013184:12345-192.168.202.7@tcp:103:lfs.0 00010000:00010000:3.0:1782224275.369246:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782224275.369273:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b164d78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51617 expref: 54 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.369287:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b164dd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5162c expref: 53 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.369294:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b164c83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515d8 expref: 52 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.369300:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96eaa7d65000) 00010000:00010000:3.0:1782224275.369306:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224275.369344:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+51:10406:x1868797312013184:12345-192.168.202.7@tcp:103:lfs.0 Request processed in 111us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224275.369348:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:2.0:1782224275.371206:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224275.371256:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312013312 00000100:00100000:1.0:1782224275.371264:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312013312 00000100:00100000:1.0:1782224275.371311:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 66 00000100:00100000:1.0:1782224275.371321:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+51:10406:x1868797312013312:12345-192.168.202.7@tcp:58:lfs.0 00010000:00010000:1.0:1782224275.371437:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164def lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224275.371454:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164def lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224275.371463:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164def lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782224275.371784:0:6605:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782224275.371951:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1782224275.372072:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1782224275.372171:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+51:10406:x1868797312013312:12345-192.168.202.7@tcp:58:lfs.0 Request processed in 850us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224275.372180:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 66 00000100:00100000:2.0:1782224275.385886:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224275.385936:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312013440 00000100:00100000:3.0:1782224275.385946:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312013440 00000100:00100000:3.0:1782224275.386235:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 67 00000100:00100000:3.0:1782224275.386246:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+51:10408:x1868797312013440:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1782224275.386266:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224275.386287:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164df6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5163a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.386744:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164dfd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.386757:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164dfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.386766:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164dfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.386788:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.386793:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.386799:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.386887:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164e0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.386893:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164e0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.386898:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164e0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224275.386930:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1782224275.386934:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782224275.386953:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164e0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.386965:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164e0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.386974:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164dfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.386981:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164dfd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.386999:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164dfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.387005:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224275.387009:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164dfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.387046:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164dfd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.387058:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:3.0:1782224275.387061:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224275.387066:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164dfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.387161:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164dfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.387179:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.387186:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.387192:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.387196:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224275.387199:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.387217:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.387226:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96ea87df7a00) 00010000:00010000:3.0:1782224275.387228:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224275.387231:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.387236:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.387266:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164df6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5163a expref: 53 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.387277:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164e0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5163a expref: 52 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224275.387284:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508f700) 00010000:00010000:3.0:1782224275.387287:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782224275.387289:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675a00, rc 0) 00000100:00100000:3.0:1782224275.387823:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:10408:x1868797312013440:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1577us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224275.387832:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 67 00000040:00080000:2.0:1782224276.117201:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782224276.117212:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782224276.117264:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1782224276.117271:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782224276.117413:0:11523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eac1d88700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11523:1868797333012736:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782224276.117518:0:11523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832edcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782224276.123704:0:11523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eac1d88700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11523:1868797333012736:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782224276.124039:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224276.124373:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312013568 00000100:00100000:3.0:1782224276.124380:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312013568 00000100:00100000:3.0:1782224276.124444:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:3.0:1782224276.124455:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:10419:x1868797312013568:12345-192.168.202.7@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1782224276.124539:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:10419:x1868797312013568:12345-192.168.202.7@tcp:900:lhsmtool_posix.0 Request processed in 85us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224276.124547:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:3.0:1782224276.127845:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224276.127926:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312013696 00000100:00100000:0.0:1782224276.127935:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312013696 00000100:00100000:0.0:1782224276.128004:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 68 00000100:00100000:0.0:1782224276.128037:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:10419:x1868797312013696:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782224276.128070:0:5786:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782224276.128192:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:10419:x1868797312013696:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 178us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224276.128200:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 68 00000100:00100000:1.0:1782224276.134900:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224276.134974:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312013824 00000100:00100000:0.0:1782224276.134984:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312013824 00000100:00100000:0.0:1782224276.135072:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:0.0:1782224276.135085:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:10419:x1868797312013824:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1782224276.135268:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b164e12 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135286:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b164e12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135297:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b164e12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135312:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e19 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135319:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135326:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135364:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135374:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135382:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224276.135423:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1782224276.135427:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782224276.135439:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135450:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b164e12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135462:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b164e12 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135468:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b164e12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135474:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224276.135479:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b164e12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135486:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b164e12 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135499:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96ea87df7c00) 00010000:00010000:0.0:1782224276.135502:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224276.135507:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b164e12 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135513:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b164e12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135524:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135531:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e19 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135537:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135542:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224276.135549:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135555:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e19 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135562:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff96eaa7d65100) 00010000:00010000:0.0:1782224276.135565:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224276.135568:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e19 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135573:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e19 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135587:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135593:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135599:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135604:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74000 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224276.135607:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135612:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135619:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508f700) 00010000:00010000:0.0:1782224276.135621:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224276.135631:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.135648:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224276.135726:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:10419:x1868797312013824:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 Request processed in 644us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224276.135735:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:3.0:1782224276.138717:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224276.138793:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312014080 00000100:00100000:0.0:1782224276.138802:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312014080 00000100:00100000:0.0:1782224276.138859:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 70 00000100:00100000:0.0:1782224276.138870:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:10419:x1868797312014080:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782224276.138892:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224276.142282:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b164e27 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51641 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.142421:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164e2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.142438:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.142450:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224276.142462:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1782224276.142569:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.142588:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164e2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.142596:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164e2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.142602:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224276.142607:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164e2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.142615:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164e2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.142627:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508f700) 00010000:00010000:1.0:1782224276.142631:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782224276.142645:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164e2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.142652:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164e2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.142702:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b164e27 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51641 expref: 54 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.142712:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96ea87df7c00) 00010000:00010000:1.0:1782224276.142715:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782224276.142719:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b164e27 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51641 expref: 54 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.142729:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74c00, rc 0) 00000100:00100000:1.0:1782224276.142808:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+53:10419:x1868797312014080:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 3938us (4101us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1782224276.142818:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 70 00000100:00100000:3.0:1782224276.146245:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224276.146352:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312014208 00000100:00100000:0.0:1782224276.146362:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312014208 00000100:00100000:0.0:1782224276.146418:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 71 00000100:00100000:0.0:1782224276.146428:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+53:10419:x1868797312014208:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782224276.146465:0:5788:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782224276.146574:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+53:10419:x1868797312014208:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 147us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224276.146582:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 71 00000100:00100000:1.0:1782224276.151368:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224276.151524:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312014464 00000100:00100000:0.0:1782224276.151535:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312014464 00000100:00100000:0.0:1782224276.151599:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 72 00000100:00100000:0.0:1782224276.151610:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+53:10419:x1868797312014464:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782224276.151630:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224276.151642:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782224276.151677:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b164de8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51633 expref: 53 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.151699:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:0.0:1782224276.151704:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782224276.151720:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b164e3c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51648 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782224276.152316:0:6605:0:(osp_object.c:1673:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1782224276.153623:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164e43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.153651:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.153664:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.153734:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b164e3c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51648 expref: 55 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.153755:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51648 expref: 54 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.153763:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96eaa7d65600) 00010000:00010000:0.0:1782224276.153766:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782224276.153769:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74e00, rc 0) 00000100:00100000:0.0:1782224276.153850:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:10419:x1868797312014464:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 2240us (2492us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1782224276.153874:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 72 00000100:00100000:3.0:1782224276.158440:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224276.158812:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312014720 00000100:00100000:0.0:1782224276.158824:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312014720 00000100:00100000:0.0:1782224276.158883:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 73 00000100:00100000:0.0:1782224276.158893:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:10419:x1868797312014720:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782224276.158956:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224276.158981:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b164e43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51648 expref: 54 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.158997:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96eaa7d65600) 00010000:00010000:0.0:1782224276.159005:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782224276.159046:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e51 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159060:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159069:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159082:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x1bea1568 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159089:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1bea1568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159096:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1bea1568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159331:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159402:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e51 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159409:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e51 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159415:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74000 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224276.159420:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e51 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159428:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e51 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159437:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:0.0:1782224276.159439:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224276.159443:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e51 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159449:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b164e51 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159458:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1bea1568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159463:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1bea1568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159469:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1bea1568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159479:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224276.159482:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1bea1568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159488:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1bea1568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159494:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x1bea1568 (ffff96eaa7d65100) 00010000:00010000:0.0:1782224276.159496:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224276.159499:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e58 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1bea1568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.159504:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1bea1568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224276.159577:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+53:10419:x1868797312014720:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 685us (1239us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782224276.159585:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 73 00000100:00100000:0.0:1782224276.165278:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224276.167465:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312014848 00000100:00100000:3.0:1782224276.167478:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312014848 00000100:00100000:3.0:1782224276.167538:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 74 00000100:00100000:3.0:1782224276.167548:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+53:10419:x1868797312014848:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782224276.167568:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224276.167591:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164e5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5164f expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.167626:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.167648:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.167660:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.167760:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164e5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5164f expref: 55 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.167778:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5164f expref: 54 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.167792:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96ea87df7400) 00010000:00010000:3.0:1782224276.167796:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782224276.167799:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675c00, rc 0) 00000100:00100000:3.0:1782224276.167875:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:10419:x1868797312014848:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 328us (2768us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224276.167882:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 74 00000100:00100000:2.0:1782224276.170803:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224276.170881:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312015104 00000100:00100000:3.0:1782224276.170891:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312015104 00000100:00100000:3.0:1782224276.170961:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 75 00000100:00100000:3.0:1782224276.170972:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:10419:x1868797312015104:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782224276.171087:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164e6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.171103:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164e6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.171124:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164e6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782224276.171499:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1782224276.171510:0:5788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 356951494452ns, next at 357951492009ns, rc = 0 00000004:00010000:3.0:1782224276.171603:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000698a1a39 reply state 00000000f31b5ca3 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164e6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224276.171612:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782224276.171728:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+56:10419:x1868797312015104:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 756us (933us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1782224276.171749:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 75 00010000:00010000:2.0:1782224276.180320:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224276.187238:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224276.187278:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312015232 00000100:00100000:0.0:1782224276.187290:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312015232 00000100:00100000:0.0:1782224276.187364:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 76 00000100:00100000:0.0:1782224276.187376:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+56:10419:x1868797312015232:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782224276.187402:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224276.187425:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51656 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.187502:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51656 expref: 57 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.187517:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51656 expref: 57 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.187537:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96ea87df7400) 00010000:00010000:0.0:1782224276.187540:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782224276.187543:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a75c00, rc 0) 00000100:00100000:0.0:1782224276.187604:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:10419:x1868797312015232:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 230us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224276.187612:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 76 00010000:00010000:3.0:1782224276.188462:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164e6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.188473:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164e6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.188480:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164e6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.188487:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224276.188491:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164e6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.188499:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164e6d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.188513:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96ea87df7400) 00010000:00010000:3.0:1782224276.188516:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782224276.188519:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164e6d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.188526:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164e6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224276.194721:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224276.194805:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312015360 00000100:00100000:3.0:1782224276.194815:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312015360 00000100:00100000:3.0:1782224276.194863:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00100000:3.0:1782224276.194871:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1868797312015360:12345-192.168.202.7@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1782224276.194906:0:6582:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:3.0:1782224276.194945:0:6582:0:(genops.c:1406:class_connect()) connect: client 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39, cookie 0xcfd8b3ae4b164e7b 00002000:00100000:3.0:1782224276.194972:0:6582:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39/ffff96ea85d62800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782224276.194998:0:6582:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:3.0:1782224276.195538:0:6582:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782224276.195567:0:6582:0:(import.c:65:import_set_state_nolock()) ffff96ea85d65000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782224276.195677:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2345:x1868797312015360:12345-192.168.202.7@tcp:8:lhsmtool_posix.0 Request processed in 804us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224276.195688:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 24 00000040:00080000:1.0:1782224276.196493:0:11839:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782224276.196499:0:11839:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782224276.196532:0:11839:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1782224276.196544:0:11839:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782224276.206567:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224276.214490:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312015488 00000100:00100000:3.0:1782224276.214506:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312015488 00000100:00100000:0.0:1782224276.214856:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 25 00000100:00100000:0.0:1782224276.214870:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:0:x1868797312015488:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1782224276.225443:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1782224276.311275:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:3.0:1782224276.311294:0:7486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 00000100:00100000:3.0:1782224276.311409:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:0:x1868797312015488:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 96537us (104842us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1782224276.311420:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 25 00000100:00100000:1.0:1782224276.318353:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224276.319335:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312015744 00000100:00100000:3.0:1782224276.319348:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312015744 00000100:00100000:3.0:1782224276.319408:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:3.0:1782224276.319418:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+56:10419:x1868797312015744:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782224276.319677:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:10419:x1868797312015744:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 259us (1332us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1782224276.319684:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:0.0:1782224276.325576:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224276.325663:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312016000 00000100:00100000:3.0:1782224276.325675:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312016000 00000100:00100000:3.0:1782224276.325742:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 77 00000100:00100000:3.0:1782224276.325754:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:10419:x1868797312016000:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782224276.325880:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:10419:x1868797312016000:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 128us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224276.325888:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 77 00000100:00100000:1.0:1782224276.332143:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224276.332251:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312016128 00000100:00100000:3.0:1782224276.332262:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312016128 00000100:00100000:3.0:1782224276.332322:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 78 00000100:00100000:3.0:1782224276.332334:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:10419:x1868797312016128:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782224276.332356:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224276.332388:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164e82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5165d expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.332479:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164e89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.332493:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.332507:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224276.332546:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782224276.332567:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.332598:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164e82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5165d expref: 59 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.332619:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164e89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5165d expref: 58 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.332665:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96ea87df7400) 00010000:00010000:3.0:1782224276.332669:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782224276.332673:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674e00, rc 0) 00000100:00100000:3.0:1782224276.332738:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+58:10419:x1868797312016128:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 407us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224276.332747:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 78 00000100:00100000:3.0:1782224276.340601:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224276.341222:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312016256 00000100:00100000:1.0:1782224276.341234:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312016256 00000100:00100000:1.0:1782224276.341296:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 26 00000100:00100000:1.0:1782224276.341307:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2346:x1868797312016256:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782224276.341326:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224276.341348:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f801b70a/0xcfd8b3ae4b164e90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51664 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782224276.341376:0:6715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a9593, blocks: 0x1 00010000:00010000:1.0:1782224276.341396:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=357s v=(0 0) 00010000:00010000:1.0:1782224276.341401:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224276.341412:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f801b70a/0xcfd8b3ae4b164e90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51664 expref: 6 pid: 6715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.341429:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f801b70a/0xcfd8b3ae4b164e90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51664 expref: 6 pid: 6715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.341452:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99877a00, rc 0) 00000100:00100000:1.0:1782224276.341508:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2346:x1868797312016256:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 204us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224276.341515:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 26 00000100:00100000:1.0:1782224276.352409:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224276.353089:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312016512 00000100:00100000:2.0:1782224276.353101:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312016512 00000100:00100000:2.0:1782224276.353176:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 79 00000100:00100000:2.0:1782224276.353187:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+58:10419:x1868797312016512:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782224276.353305:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+58:10419:x1868797312016512:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 119us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224276.353313:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 79 00000100:00100000:1.0:1782224276.362421:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224276.365212:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312016640 00000100:00100000:2.0:1782224276.365226:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312016640 00000100:00100000:2.0:1782224276.365346:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:2.0:1782224276.365358:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc89bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:10419:x1868797312016640:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782224276.365377:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224276.365398:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b164e97 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5166b expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.365428:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f801b70a/0xcfd8b3ae4b164e90 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51664 expref: 7 pid: 6715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.365437:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782224276.365441:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782224276.365447:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b164e97 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5166b expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.365478:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f801b70a/0xcfd8b3ae4b164e90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51664 expref: 7 pid: 6715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.365504:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f801b70a/0xcfd8b3ae4b164e90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51664 expref: 7 pid: 6715 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224276.365519:0:6584:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eac1d89c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6584:1868797333012864:192.168.202.7@tcp:104: 00000100:00100000:2.0:1782224276.365619:0:6584:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832ede40 going to sleep for 11 seconds 00000100:00100000:2.0:1782224276.381313:0:6584:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eac1d89c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6584:1868797333012864:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224276.381348:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b164e97 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5166b expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.381368:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab000, rc 0) 00000100:00100000:2.0:1782224276.381422:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc89bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:10419:x1868797312016640:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 16067us (19012us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224276.381431:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:2.0:1782224276.381534:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224276.381611:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312016768 00000100:00100000:2.0:1782224276.381619:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312016768 00010000:00010000:2.0:1782224276.381663:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f801b70a/0xcfd8b3ae4b164e90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51664 expref: 7 pid: 6715 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224276.381696:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 42 00000100:00100000:2.0:1782224276.381706:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea860b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2347:x1868797312016768:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782224276.381721:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224276.381746:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f801b70a/0xcfd8b3ae4b164e90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51664 expref: 7 pid: 6715 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.381771:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f801b70a/0xcfd8b3ae4b164e90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51664 expref: 7 pid: 6715 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.381797:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f801b70a/0xcfd8b3ae4b164e90 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51664 expref: 7 pid: 6715 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.381812:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782224276.381816:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782224276.381824:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b164e97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5166b expref: 6 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.381836:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b164e97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5166b expref: 6 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.381868:0:5771:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b164e97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5166b expref: 6 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224276.381882:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eac1d89c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5771:1868797333012992:192.168.202.7@tcp:105: 00000100:00100000:2.0:1782224276.381946:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1782224276.398500:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224276.398640:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eac1d89c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5771:1868797333012992:192.168.202.7@tcp:105: 00010000:00010000:3.0:1782224276.398663:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224276.398727:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea860b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797312016768:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 17022us (17192us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224276.398738:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 42 00000100:00100000:3.0:1782224276.398810:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312016896 00000100:00100000:3.0:1782224276.398817:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312016896 00002000:00100000:3.0:1782224276.398857:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff96eabbbdca80 x1868797312016896/t0(0) o4->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:732/0 lens 504/0 e 0 to 0 dl 1782224287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782224276.398868:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96eabbbdca80 with x1868797312016896 ext(0->8) 00002000:00010000:3.0:1782224276.398872:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96eabbbdca80 00000100:00100000:3.0:1782224276.398896:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:3.0:1782224276.398905:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797312016896:12345-192.168.202.7@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1782224276.403707:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2347:x1868797312016896:12345-192.168.202.7@tcp:4:lhsmtool_posix.0 Request processed in 4790us (5205us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1782224276.403722:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 0 00002000:00100000:3.0:1782224276.403746:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff96eabbbdca80 x1868797312016896/t4294967302(0) o4->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:732/0 lens 504/448 e 0 to 0 dl 1782224287 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782224276.403758:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96eabbbdca80 with x1868797312016896 ext(0->8) 00002000:00010000:3.0:1782224276.403765:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96eabbbdca80 00000100:00100000:3.0:1782224276.412835:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224276.412965:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312017024 00000100:00100000:1.0:1782224276.412977:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312017024 00000100:00100000:1.0:1782224276.416461:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 80 00000100:00100000:1.0:1782224276.416488:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+58:10419:x1868797312017024:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1782224276.466549:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:3.0:1782224276.466623:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1782224276.466655:0:5808:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96ea832b0b40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1782224276.466660:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff96ea90e8f900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96ea832b0780 00000020:00080000:3.0:1782224276.466664:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff96ea90e8f100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96ea85293800 00000001:00080000:3.0:1782224276.466686:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1782224276.466692:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1782224276.466836:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1782224276.466949:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1782224276.467267:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:10419:x1868797312017024:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 Request processed in 50789us (54438us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224276.467278:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 80 00000100:00100000:2.0:1782224276.468463:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333013120:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782224276.468531:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224276.469136:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333013120 00000100:00100000:1.0:1782224276.469155:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333013120 00000100:00100000:1.0:1782224276.469217:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782224276.469226:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1868797333013120:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782224276.469253:0:6715:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1782224276.469285:0:6715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a3a9591, atime: 0x6a3a9591, ctime: 0x6a3a9591, blocks: 0x1 00010000:00010000:1.0:1782224276.469293:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c90e726d/0xcfd8b3ae4b164e9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.469307:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=357s v=(0 0) 00010000:00010000:1.0:1782224276.469311:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224276.469317:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c90e726d/0xcfd8b3ae4b164e9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.469331:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c90e726d/0xcfd8b3ae4b164e9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.469348:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c90e726d/0xcfd8b3ae4b164e9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.469355:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c90e726d/0xcfd8b3ae4b164e9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.469370:0:6715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782224276.469942:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1868797333013120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 715us (1408us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1782224276.469951:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1782224276.474204:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782224276.474244:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782224276.474254:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c90e726d/0xcfd8b3ae4b164e9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.474269:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99877c00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:2.0:1782224276.474274:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c90e726d/0xcfd8b3ae4b164e9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.474286:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c90e726d/0xcfd8b3ae4b164e9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.474309:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c90e726d/0xcfd8b3ae4b164e9e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.474317:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c90e726d/0xcfd8b3ae4b164e9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.474343:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224276.474345:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224276.474347:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782224276.474399:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96e9879d7800/2, rc 0, transno 4294967301 00000100:00100000:2.0:1782224276.474408:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333013120:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782224276.475330:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782224276.477540:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224276.477961:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333013248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1782224276.478044:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224276.478185:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312017152 00000100:00100000:2.0:1782224276.478194:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312017152 00000100:00100000:2.0:1782224276.478249:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333013248 00000100:00100000:2.0:1782224276.478253:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333013248 00000100:00100000:2.0:1782224276.478291:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 29 00000100:00100000:2.0:1782224276.478315:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2346:x1868797312017152:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1782224276.478381:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782224276.478389:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333013248:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1782224276.478541:0:6582:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1782224276.478544:0:6582:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782224276 00002000:00010000:2.0:1782224276.478546:0:6582:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782224276.478549:0:6582:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1782224275 -> 1782224276 00002000:00010000:2.0:1782224276.478551:0:6582:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782224276.478594:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1868797333013248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 205us (549us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1782224276.478614:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:2.0:1782224276.478667:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96e9879d5880/2, rc 0, transno 4294967303 00000100:00100000:2.0:1782224276.478673:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333013248:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1782224276.480237:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1782224276.525042:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1782224276.525399:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2346:x1868797312017152:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 Request processed in 47080us (47861us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224276.525410:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 29 00000001:00080000:1.0:1782224276.526493:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1782224276.527949:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224276.528188:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312017408 00000100:00100000:3.0:1782224276.528197:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312017408 00000100:00100000:3.0:1782224276.528259:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 81 00000100:00100000:3.0:1782224276.528269:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:10419:x1868797312017408:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782224276.528323:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224276.528349:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164e89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5165d expref: 13 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.528372:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96ea87df7400) 00010000:00010000:3.0:1782224276.528388:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782224276.528416:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164ea5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.528429:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.528438:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782224276.528709:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000043e6756 reply state 0000000089345968 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224276.528718:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782224276.528834:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+14:10419:x1868797312017408:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 566us (894us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1782224276.528841:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 81 00010000:00010000:3.0:1782224276.531743:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.531762:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164ea5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.531769:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164ea5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.531775:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224276.531780:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164ea5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.531788:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164ea5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.531824:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96ea87df7400) 00010000:00010000:3.0:1782224276.531827:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224276.531832:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164ea5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.531838:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b164ea5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224276.534971:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224276.535417:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312017536 00000100:00100000:0.0:1782224276.535428:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312017536 00000100:00100000:0.0:1782224276.535498:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 31 00000100:00100000:0.0:1782224276.535510:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2346:x1868797312017536:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782224276.535899:0:6582:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1782224276.535904:0:6582:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1782224276 -> 1782224274 00002000:00010000:0.0:1782224276.535907:0:6582:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1782224273 00002000:00010000:0.0:1782224276.535910:0:6582:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1782224276 -> 1782224274 00002000:00010000:0.0:1782224276.535912:0:6582:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1782224276.535990:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312017536:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 482us (1036us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1782224276.535999:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 31 00000100:00100000:2.0:1782224276.538888:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224276.538995:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312017792 00000100:00100000:1.0:1782224276.539006:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312017792 00000100:00100000:1.0:1782224276.539108:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 82 00000100:00100000:1.0:1782224276.539128:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:10419:x1868797312017792:12345-192.168.202.7@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1782224276.539209:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164eac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.539227:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5164f expref: 13 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.539237:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164eac lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.539290:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5164f expref: 13 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.539304:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5164f expref: 13 pid: 6605 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224276.539318:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc899f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1868797333013376:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224276.539407:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905f2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782224276.542528:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc899f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1868797333013376:192.168.202.7@tcp:104: 00010000:00010000:1.0:1782224276.542557:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164eac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224276.544797:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224276.545170:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312017920 00000100:00100000:3.0:1782224276.545181:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312017920 00010000:00010000:3.0:1782224276.545224:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5164f expref: 14 pid: 6605 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224276.545266:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00100000:3.0:1782224276.545276:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+14:2347:x1868797312017920:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224276.545291:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224276.545298:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5164f expref: 14 pid: 6605 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.545312:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5164f expref: 14 pid: 6605 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.545335:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164e66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5164f expref: 14 pid: 6605 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.545356:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96ea87df7400) 00010000:00010000:3.0:1782224276.545361:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164eac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.545386:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.545394:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164eac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.545432:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224276.545491:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:2347:x1868797312017920:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 216us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224276.545499:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 43 00010000:00010000:2.0:1782224276.545744:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.545752:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.545783:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.545790:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164eac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.545804:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164eac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.545810:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99877c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224276.545814:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164eac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.545821:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164eac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.545830:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96ea87df7400) 00010000:00010000:2.0:1782224276.545833:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1782224276.545837:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164eac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.545843:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164eac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224276.545884:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+12:10419:x1868797312017792:12345-192.168.202.7@tcp:55:lhsmtool_posix.0 Request processed in 6759us (7006us total) trans 0 rc -22/-22 00000100:00100000:2.0:1782224276.545893:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 82 00000100:00100000:2.0:1782224276.549622:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224276.549779:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312018048 00000100:00100000:3.0:1782224276.549789:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312018048 00000100:00100000:3.0:1782224276.549845:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 32 00000100:00100000:3.0:1782224276.549855:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2347:x1868797312018048:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1782224276.549895:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a4b3be40/0xcfd8b3ae4b164eb3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.549917:0:6585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b164e97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5166b expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.549926:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782224276.549930:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782224276.549935:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4b3be40/0xcfd8b3ae4b164eb3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.549978:0:6585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b164e97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5166b expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.550009:0:6585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b164e97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5166b expref: 7 pid: 6584 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224276.550047:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6585:1868797333013504:192.168.202.7@tcp:104: 00000100:00100000:3.0:1782224276.550152:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8badab40 going to sleep for 11 seconds 00000100:00100000:3.0:1782224276.553852:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6585:1868797333013504:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224276.553884:0:6585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a4b3be40/0xcfd8b3ae4b164eb3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224276.554835:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224276.554967:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312018176 00000100:00100000:3.0:1782224276.554976:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312018176 00010000:00010000:3.0:1782224276.555047:0:8291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b164e97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5166b expref: 8 pid: 6584 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224276.555086:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 44 00000100:00100000:3.0:1782224276.555096:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2347:x1868797312018176:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224276.555120:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224276.555143:0:8291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b164e97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5166b expref: 8 pid: 6584 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.555157:0:8291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b164e97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5166b expref: 8 pid: 6584 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.555180:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b164e97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5166b expref: 8 pid: 6584 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.555204:0:8291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782224276.555208:0:8291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782224276.555213:0:8291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4b3be40/0xcfd8b3ae4b164eb3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.555222:0:8291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4b3be40/0xcfd8b3ae4b164eb3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.555243:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224276.555304:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2347:x1868797312018176:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 209us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224276.555312:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 44 00010000:00010000:0.0:1782224276.555602:0:6585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a4b3be40/0xcfd8b3ae4b164eb3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.555614:0:6585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4b3be40/0xcfd8b3ae4b164eb3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.555648:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a4b3be40/0xcfd8b3ae4b164eb3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.555657:0:6585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4b3be40/0xcfd8b3ae4b164eb3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.555664:0:6585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4b3be40/0xcfd8b3ae4b164eb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.555670:0:6585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674800 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224276.555674:0:6585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4b3be40/0xcfd8b3ae4b164eb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.555695:0:6585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4b3be40/0xcfd8b3ae4b164eb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.555708:0:6585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4b3be40/0xcfd8b3ae4b164eb3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224276.555715:0:6585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4b3be40/0xcfd8b3ae4b164eb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224276.555860:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797312018048:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 Request processed in 6005us (6247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224276.555868:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 32 00000100:00100000:2.0:1782224276.558809:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224276.558881:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312018432 00000100:00100000:3.0:1782224276.558892:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312018432 00000100:00100000:3.0:1782224276.558955:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 83 00000100:00100000:3.0:1782224276.558969:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+12:10419:x1868797312018432:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1782224276.559282:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164eba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.559301:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164eba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.559313:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164eba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.559590:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164ec1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.559640:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51656 expref: 13 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.559650:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164ec1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.559683:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51656 expref: 13 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.559699:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51656 expref: 13 pid: 6605 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224276.559715:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333013632:192.168.202.7@tcp:104: 00000100:00100000:3.0:1782224276.559847:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa7a0ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1782224276.564514:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc01dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333013760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782224276.564607:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224276.564725:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333013760 00000100:00100000:2.0:1782224276.564734:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333013760 00000100:00100000:2.0:1782224276.564796:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782224276.564807:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1868797333013760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782224276.564848:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224276.564907:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1868797333013760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224276.564915:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782224276.565008:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc01dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333013760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782224276.567755:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224276.567865:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312018560 00000100:00100000:1.0:1782224276.567875:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312018560 00010000:00010000:1.0:1782224276.567914:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e74 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51656 expref: 14 pid: 6605 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224276.567956:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:1.0:1782224276.567973:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+14:2346:x1868797312018560:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782224276.567987:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224276.567994:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e74 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51656 expref: 14 pid: 6605 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.568007:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51656 expref: 14 pid: 6605 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.568084:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96ea87df7400) 00010000:00010000:1.0:1782224276.568090:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164ec1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.568099:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.568107:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164ec1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.568136:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224276.568431:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+14:2346:x1868797312018560:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 459us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224276.568439:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 45 00010000:00010000:3.0:1782224276.569443:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b164e74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51656 expref: 13 pid: 6605 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224276.569463:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333013632:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224276.569556:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.569723:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.569731:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782224276.569920:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1782224276.570376:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1782224276.570419:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1782224276.570590:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc01ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5788:1868797333013888:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782224276.570750:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224276.570825:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832ed6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782224276.570877:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333013888 00000100:00100000:3.0:1782224276.570885:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333013888 00000100:00100000:3.0:1782224276.571483:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782224276.571493:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5788:x1868797333013888:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782224276.571579:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5788:x1868797333013888:12345-0@lo:1000:mdt00_002.0 Request processed in 88us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224276.571603:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782224276.571667:0:5788:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1782224276.571673:0:5788:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96e9879d5880, transno 4294967303 00000100:00100000:2.0:1782224276.571697:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc01ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5788:1868797333013888:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1782224276.572412:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1782224276.572493:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc01ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5788:1868797333014016:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782224276.572535:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224276.573330:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1782224276.573361:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333014016 00000100:00100000:0.0:1782224276.573368:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333014016 00000100:00100000:1.0:1782224276.573606:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782224276.573616:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5788:x1868797333014016:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782224276.573839:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5788:x1868797333014016:12345-0@lo:1000:mdt00_002.0 Request processed in 223us (1302us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1782224276.573846:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782224276.573941:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc01ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5788:1868797333014016:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1782224276.573985:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.573996:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164ec1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.574035:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164ec1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.574041:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224276.574045:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164ec1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.574053:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164ec1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.574068:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96ea87df7400) 00010000:00010000:2.0:1782224276.574071:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782224276.574076:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164ec1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.574081:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164ec1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.574283:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164def lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.574291:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164def lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.574297:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164def lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.574302:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224276.574305:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164def lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.574322:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164def lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.574331:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508f700) 00010000:00010000:2.0:1782224276.574333:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782224276.574337:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164def lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.574342:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164def lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.574384:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164ec8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.574399:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164e0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5163a expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.574408:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164ec8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.574436:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164e0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5163a expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.574450:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164e0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5163a expref: 16 pid: 5788 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224276.574462:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc01df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333014144:192.168.202.7@tcp:104: 00000100:00100000:2.0:1782224276.574549:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782224276.583870:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224276.583954:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312018688 00000100:00100000:3.0:1782224276.583963:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312018688 00010000:00010000:3.0:1782224276.584004:0:8291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164e0b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5163a expref: 17 pid: 5788 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224276.584081:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00100000:3.0:1782224276.584091:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+17:2347:x1868797312018688:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224276.584107:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224276.584126:0:8291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164e0b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5163a expref: 17 pid: 5788 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.584141:0:8291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164e0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5163a expref: 17 pid: 5788 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.584228:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508f700) 00010000:00010000:3.0:1782224276.584235:0:8291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164ec8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.584247:0:8291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164ec8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.584255:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164ec8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224276.584276:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224276.584340:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+17:2347:x1868797312018688:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 249us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224276.584365:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 46 00010000:00010000:2.0:1782224276.584640:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164e0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5163a expref: 16 pid: 5788 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224276.584668:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc01df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333014144:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224276.584689:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164ec8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.584698:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164ec8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.584704:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164ec8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.584715:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164ec8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.584722:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164ec8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.584728:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164ec8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.584734:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab000 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224276.584738:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164ec8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.584746:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164ec8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.584755:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508f700) 00010000:00010000:2.0:1782224276.584758:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224276.584762:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164ec8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.584779:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b164ec8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.584792:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164eba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.584798:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164eba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.584804:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164eba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.584809:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224276.584812:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164eba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.584818:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164eba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.584826:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508f700) 00010000:00010000:2.0:1782224276.584828:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782224276.584831:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164eba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.584836:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164eba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224276.585071:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+15:10419:x1868797312018432:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 26105us (26272us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1782224276.585080:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 83 00000020:00080000:2.0:1782224276.585089:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1782224276.585372:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782224276.585377:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782224276.585406:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782224276.585412:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782224276.588203:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224276.588292:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312018944 00000100:00100000:3.0:1782224276.588302:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312018944 00000100:00100000:3.0:1782224276.588357:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:3.0:1782224276.588367:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+15:10419:x1868797312018944:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1782224276.590855:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1782224276.590996:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1782224276.591083:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b164ecf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.591100:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b164ecf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.591111:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b164ecf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.591129:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b164ecf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.591136:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b164ecf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.591142:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b164ecf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224276.591365:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782224276.591485:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+17:10419:x1868797312018944:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 3115us (3344us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1782224276.591495:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 20 00000020:00080000:2.0:1782224276.591500:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782224276.592744:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224276.592755:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b164ecf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.592765:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224276.592770:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b164ecf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.592779:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b164ecf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.592809:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96ea8635f900) 00010000:00010000:1.0:1782224276.592812:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782224276.592816:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b164ecf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.592823:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b164ecf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224276.592844:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224276.592846:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224276.592848:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224277.204212:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224277.588549:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabbbdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797333014272:0@lo:400:kworker.0 00000100:00100000:2.0:1782224277.588638:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224277.588730:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333014272 00000100:00100000:1.0:1782224277.588738:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333014272 00000100:00100000:1.0:1782224277.588789:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1782224277.588799:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797333014272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224277.595796:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333014656:0@lo:400:kworker.0 00000100:00100000:3.0:1782224277.595890:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224277.596243:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797333014272:12345-0@lo:400:kworker.0 Request processed in 7443us (7602us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224277.596256:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1782224277.596798:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabbbdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797333014272:0@lo:400:kworker.0 00000100:00100000:1.0:1782224277.597107:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797333014528:0@lo:400:kworker.0 00000100:00100000:1.0:1782224277.597155:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224277.597188:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782224277.597196:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868797333014400:0@lo:400:kworker.0 00000100:00100000:1.0:1782224277.597221:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224277.597223:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333014528 00000100:00100000:2.0:1782224277.597244:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333014528 00000100:00100000:3.0:1782224277.597272:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333014400 00000100:00100000:3.0:1782224277.597278:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333014400 00000100:00100000:2.0:1782224277.597319:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782224277.597332:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797333014528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224277.597334:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1782224277.597347:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc89b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868797333014400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224277.597358:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333014656 00000100:00100000:0.0:1782224277.597365:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333014656 00000100:00100000:0.0:1782224277.597402:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782224277.597411:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1868797333014656:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782224277.597419:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224277.597530:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797333014528:12345-0@lo:400:kworker.0 Request processed in 202us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224277.597537:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1782224277.597604:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797333014528:0@lo:400:kworker.0 00000100:00100000:3.0:1782224277.602504:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc89b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868797333014400:12345-0@lo:400:kworker.0 Request processed in 5149us (5271us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224277.602518:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1782224277.602604:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1868797333014656:12345-0@lo:400:kworker.0 Request processed in 5192us (6711us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224277.602641:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782224277.602715:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333014656:0@lo:400:kworker.0 00000100:00100000:1.0:1782224277.602780:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868797333014400:0@lo:400:kworker.0 00000100:00100000:0.0:1782224277.602795:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782224277.602808:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797333014784:0@lo:400:kworker.0 00000100:00100000:2.0:1782224277.603224:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333014912:0@lo:400:kworker.0 00000100:00100000:2.0:1782224277.603260:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224277.604075:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333014912 00000100:00100000:1.0:1782224277.604084:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333014912 00000100:00100000:1.0:1782224277.604140:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782224277.604150:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1868797333014912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224277.604203:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1868797333014912:12345-0@lo:400:kworker.0 Request processed in 56us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224277.604210:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782224277.604316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224277.604381:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333014784 00000100:00100000:1.0:1782224277.604385:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333014784 00000100:00080000:0.0:1782224277.604424:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224277.604434:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1782224277.604442:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797333014784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224277.604511:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797333014784:12345-0@lo:400:kworker.0 Request processed in 69us (1660us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224277.604518:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1782224277.604561:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797333014784:0@lo:400:kworker.0 00000100:00100000:2.0:1782224277.604748:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333014912:0@lo:400:kworker.0 00000100:00100000:1.0:1782224278.040328:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224278.040363:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224278.040401:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224278.040425:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224278.040464:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224278.040517:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312019200 00000100:00100000:1.0:1782224278.040526:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312019200 00000100:00100000:0.0:1782224278.040565:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312019456 00000100:00100000:0.0:1782224278.040569:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312019456 00000100:00100000:1.0:1782224278.040580:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312019584 00000100:00100000:1.0:1782224278.040582:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312019584 00000100:00100000:0.0:1782224278.040595:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312019328 00000100:00100000:0.0:1782224278.040597:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312019328 00000100:00100000:1.0:1782224278.040603:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 137 00000100:00100000:1.0:1782224278.040612:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc89b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+17:2347:x1868797312019200:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224278.040629:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 76 00000100:00100000:0.0:1782224278.040635:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797312019456:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224278.040829:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 138 00000100:00100000:2.0:1782224278.040839:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2347:x1868797312019584:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224278.040901:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc89b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+17:2347:x1868797312019200:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 289us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224278.040917:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 137 00000100:00080000:1.0:1782224278.043456:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782224278.043465:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782224278.043468:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224278.043505:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 77 00000100:00100000:1.0:1782224278.043523:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2347:x1868797312019328:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224278.051350:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797312019456:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 10699us (10969us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224278.051367:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 76 00000100:00100000:2.0:1782224278.053338:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2347:x1868797312019584:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 12491us (12863us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224278.053353:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 138 00000100:00100000:0.0:1782224278.054070:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312019072 00000100:00100000:0.0:1782224278.054082:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312019072 00000100:00100000:0.0:1782224278.054128:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 287 00000100:00100000:0.0:1782224278.054145:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2347:x1868797312019072:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224278.054214:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2347:x1868797312019072:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 71us (13811us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224278.054221:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 287 00000100:00100000:1.0:1782224278.054854:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2347:x1868797312019328:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 11335us (14423us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224278.054864:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 77 00000100:00100000:3.0:1782224278.100404:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333015040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782224278.100485:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224278.105529:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333015040 00000100:00100000:2.0:1782224278.105544:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333015040 00000100:00100000:2.0:1782224278.105628:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782224278.105639:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1868797333015040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782224278.105680:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224278.111440:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1868797333015040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5730us (10882us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224278.111456:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1782224278.111504:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782224278.113613:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333015040:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782224278.232287:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782224278.262700:0:11891:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782224278.262709:0:11891:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782224278.262746:0:11891:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782224278.262753:0:11891:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782224278.451685:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224278.451825:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312019840 00000100:00100000:1.0:1782224278.451836:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312019840 00000100:00100000:1.0:1782224278.451898:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 84 00000100:00100000:1.0:1782224278.451909:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+17:10438:x1868797312019840:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1782224278.451941:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224278.451963:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164ed6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51672 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.452272:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164edd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.452288:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164edd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.452298:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164edd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224278.452309:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1782224278.452746:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164ed6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51672 expref: 20 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.452773:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164edd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51672 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.452783:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:1.0:1782224278.452786:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782224278.452790:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99877a00, rc 0) 00000100:00100000:1.0:1782224278.452854:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+19:10438:x1868797312019840:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 946us (1180us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1782224278.452862:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 84 00000100:00100000:3.0:1782224278.457781:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224278.457880:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312019968 00000100:00100000:1.0:1782224278.457890:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312019968 00000100:00100000:1.0:1782224278.457944:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 85 00000100:00100000:1.0:1782224278.457955:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+19:10438:x1868797312019968:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:1.0:1782224278.458061:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164eeb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.458080:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164eeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.458092:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164eeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.458108:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164ef2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.458115:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.458132:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.459195:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164ef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.459209:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.459218:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782224278.459261:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.459273:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164eeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.459279:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164eeb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.459286:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164eeb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.459292:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224278.459296:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164eeb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.459303:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164eeb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.460185:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:1.0:1782224278.460198:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224278.460203:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164eeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.460210:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164eeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.460226:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.460232:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164ef2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.460238:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.460243:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224278.460247:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.460254:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164ef2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.460261:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96ea8508fb00) 00010000:00010000:1.0:1782224278.460264:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224278.460266:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164ef2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.460271:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164ef2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.460287:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.460299:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164ef9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.460305:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.460310:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224278.460413:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.460420:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.460428:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508f300) 00010000:00010000:1.0:1782224278.460430:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224278.460433:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164ef9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.460438:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164ef9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224278.461630:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+19:10438:x1868797312019968:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 3661us (3843us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224278.461643:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 85 00000100:00100000:3.0:1782224278.533531:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224278.541759:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312020224 00000100:00100000:1.0:1782224278.541774:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312020224 00000100:00100000:1.0:1782224278.541835:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 86 00000100:00100000:1.0:1782224278.541844:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+19:10441:x1868797312020224:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1782224278.541866:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224278.541894:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164f00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51679 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.542637:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.542655:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.542667:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.542681:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.542687:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.542698:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.546166:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164f15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.546190:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.546202:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224278.546222:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1782224278.547851:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.547882:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.547889:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.547895:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224278.547900:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.547907:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.547922:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:1.0:1782224278.547925:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224278.547938:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.547944:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.547958:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.547965:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.547970:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.547975:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99877c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224278.547985:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.547991:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.547999:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96ea8508f300) 00010000:00010000:1.0:1782224278.548002:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224278.548006:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.548012:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.549255:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164f00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51679 expref: 22 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.549274:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164f15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51679 expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.549283:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508fb00) 00010000:00010000:1.0:1782224278.549285:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782224278.549288:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99876c00, rc 0) 00000100:00100000:1.0:1782224278.551159:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+21:10441:x1868797312020224:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 9304us (17626us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1782224278.551171:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 86 00000100:00100000:3.0:1782224278.571340:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224278.571390:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312020352 00000100:00100000:0.0:1782224278.571411:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312020352 00000100:00100000:0.0:1782224278.571469:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 87 00000100:00100000:0.0:1782224278.571479:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+21:10441:x1868797312020352:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:0.0:1782224278.571550:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b164f23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224278.571567:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b164f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224278.571577:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b164f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224278.571602:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b164f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224278.571619:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b164f23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224278.571627:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b164f23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224278.571631:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224278.571636:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b164f23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224278.571643:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b164f23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224278.571654:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508fb00) 00010000:00010000:0.0:1782224278.571657:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782224278.571661:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b164f23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224278.571678:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b164f23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224278.571746:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+21:10441:x1868797312020352:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 268us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224278.571754:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 87 00000100:00100000:3.0:1782224278.573391:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224278.573505:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312020608 00000100:00100000:1.0:1782224278.573515:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312020608 00000100:00100000:1.0:1782224278.573569:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:1.0:1782224278.573579:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea9c44f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+21:10441:x1868797312020608:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:1.0:1782224278.573839:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea9c44f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+22:10441:x1868797312020608:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 260us (455us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1782224278.573847:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:3.0:1782224278.621545:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224278.622594:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312020864 00000100:00100000:1.0:1782224278.622607:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312020864 00000100:00100000:1.0:1782224278.622694:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 88 00000100:00100000:1.0:1782224278.622704:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+22:9960:x1868797312020864:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1782224278.622729:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224278.622751:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164f2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51680 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.622867:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f31 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.622883:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164f15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51679 expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.622894:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f31 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.622927:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164f15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51679 expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.622941:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164f15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51679 expref: 23 pid: 5786 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224278.622956:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabccba680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1868797333015168:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224278.623135:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224278.628462:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224278.628813:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312020992 00000100:00100000:3.0:1782224278.628823:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312020992 00010000:00010000:3.0:1782224278.628875:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164f15 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51679 expref: 24 pid: 5786 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224278.628920:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00100000:3.0:1782224278.628930:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+24:2347:x1868797312020992:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224278.628945:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224278.628951:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164f15 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51679 expref: 24 pid: 5786 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.628963:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164f15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51679 expref: 24 pid: 5786 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.628984:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508fb00) 00010000:00010000:3.0:1782224278.628990:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f31 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.629000:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.629008:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f31 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.629079:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224278.629144:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+24:2347:x1868797312020992:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 214us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224278.629152:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 47 00010000:00010000:1.0:1782224278.629421:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164f15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51679 expref: 23 pid: 5786 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224278.629440:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabccba680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1868797333015168:192.168.202.7@tcp:104: 00010000:00010000:1.0:1782224278.629459:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.629540:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.629547:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224278.629770:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1782224278.630168:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164f2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51680 expref: 24 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224278.630188:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51680 expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224278.630196:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508fb00) 00010000:00010000:0.0:1782224278.630199:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782224278.630201:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea99877c00, rc 0) 00000100:00100000:0.0:1782224278.630252:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+23:9960:x1868797312020864:12345-192.168.202.7@tcp:101:bash.0 Request processed in 7549us (8717us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1782224278.630261:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 88 00000100:00100000:0.0:1782224278.632962:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224278.633138:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312021248 00000100:00100000:2.0:1782224278.633148:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312021248 00000100:00100000:2.0:1782224278.633208:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 89 00000100:00100000:2.0:1782224278.633230:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+23:9960:x1868797312021248:12345-192.168.202.7@tcp:36:bash.0 00010000:00010000:2.0:1782224278.633486:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.633503:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.633514:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782224278.633562:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1782224278.633583:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004d09fbb reply state 000000006bd613c8 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224278.633591:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1782224278.633643:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1782224278.633733:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+27:9960:x1868797312021248:12345-192.168.202.7@tcp:36:bash.0 Request processed in 504us (781us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1782224278.633740:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 89 00000020:00080000:2.0:1782224278.633744:0:6605:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1782224278.635872:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224278.635892:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224278.635900:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224278.635940:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224278.635945:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224278.635954:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224278.635972:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508fb00) 00010000:00010000:0.0:1782224278.635975:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224278.635979:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224278.635985:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224278.637681:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224278.637887:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312021376 00000100:00100000:3.0:1782224278.637897:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312021376 00000100:00100000:3.0:1782224278.637958:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 90 00000100:00100000:3.0:1782224278.637967:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+26:9960:x1868797312021376:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:3.0:1782224278.637990:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224278.638008:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164f46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51687 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.638105:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164f46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51687 expref: 27 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.638118:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164f46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51687 expref: 27 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.638277:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508fb00) 00010000:00010000:3.0:1782224278.638281:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782224278.638284:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674200, rc 0) 00000100:00100000:3.0:1782224278.638375:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+27:9960:x1868797312021376:12345-192.168.202.7@tcp:101:bash.0 Request processed in 409us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224278.638382:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 90 00000100:00100000:0.0:1782224278.642053:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224278.642254:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312021504 00000100:00100000:2.0:1782224278.642264:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312021504 00000100:00100000:2.0:1782224278.642322:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:2.0:1782224278.642332:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:9960:x1868797312021504:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:2.0:1782224278.642350:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224278.642369:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8d721b8/0xcfd8b3ae4b164f4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5168e expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782224278.642393:0:6582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a3a9592, atime: 0x6a3a9591, ctime: 0x6a3a9592, blocks: 0xb 00010000:00010000:2.0:1782224278.642428:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=359s v=(0 0) 00010000:00010000:2.0:1782224278.642432:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782224278.642531:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8d721b8/0xcfd8b3ae4b164f4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5168e expref: 7 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.642550:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d8d721b8/0xcfd8b3ae4b164f4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5168e expref: 7 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.642564:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaae00, rc 0) 00000100:00100000:2.0:1782224278.642645:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:9960:x1868797312021504:12345-192.168.202.7@tcp:101:bash.0 Request processed in 314us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224278.642652:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:2.0:1782224278.644994:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224278.645150:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312021632 00000100:00100000:0.0:1782224278.645158:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312021632 00002000:00010000:0.0:1782224278.645194:0:6588:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1782224278.645198:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96eabc01e300 with x1868797312021632 ext(0->18446744073709551615) 00002000:00010000:0.0:1782224278.645209:0:6588:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96eabc01e300. 00000100:00100000:0.0:1782224278.645243:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:0.0:1782224278.645251:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2349:x1868797312021632:12345-192.168.202.7@tcp:10:bash.0 00002000:00010000:0.0:1782224278.645623:0:6588:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1782224278.645627:0:6588:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1782224274 -> 1782224278 00002000:00010000:0.0:1782224278.645629:0:6588:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1782224273 -> 1782224273 00002000:00010000:0.0:1782224278.645631:0:6588:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1782224274 -> 1782224278 00002000:00010000:0.0:1782224278.645654:0:6588:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1782224278.645756:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2349:x1868797312021632:12345-192.168.202.7@tcp:10:bash.0 Request processed in 505us (770us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1782224278.645764:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 1 00002000:00010000:0.0:1782224278.645768:0:6588:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1782224278.645770:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96eabc01e300 with x1868797312021632 ext(0->18446744073709551615) 00002000:00010000:0.0:1782224278.645775:0:6588:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96eabc01e300. 00000100:00100000:0.0:1782224278.730540:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224278.730744:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312021760 00000100:00100000:2.0:1782224278.730754:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312021760 00000100:00100000:2.0:1782224278.730862:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 91 00000100:00100000:2.0:1782224278.730873:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+27:10456:x1868797312021760:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:2.0:1782224278.730954:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b164f54 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.730971:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b164f54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.730982:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b164f54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.730996:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731039:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731046:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731314:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164f62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731323:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164f62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731330:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164f62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782224278.731364:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164f62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731375:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b164f54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731381:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b164f54 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731387:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b164f54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731393:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaba00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224278.731397:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b164f54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731404:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b164f54 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731421:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:2.0:1782224278.731424:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224278.731428:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b164f54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731434:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b164f54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731445:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731451:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731456:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731461:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224278.731464:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731470:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731476:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96ea8635f600) 00010000:00010000:2.0:1782224278.731478:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224278.731481:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731486:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b164f5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731508:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164f62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731514:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164f62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731519:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164f62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731524:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224278.731527:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164f62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731533:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164f62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731541:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508fb00) 00010000:00010000:2.0:1782224278.731543:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224278.731546:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164f62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.731551:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b164f62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224278.731682:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+27:10456:x1868797312021760:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 810us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224278.731690:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 91 00000100:00100000:3.0:1782224278.767120:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224278.767284:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312022016 00000100:00100000:1.0:1782224278.767293:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312022016 00000100:00100000:1.0:1782224278.767352:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 92 00000100:00100000:1.0:1782224278.767361:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+27:10459:x1868797312022016:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1782224278.767389:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224278.767408:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164f69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51695 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.767474:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f70 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.767489:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.767500:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.767527:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164f77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.767534:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164f77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.767540:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164f77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768077:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b164f7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768088:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b164f7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768095:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b164f7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224278.768105:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1782224278.768185:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768192:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f70 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768200:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768205:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224278.768209:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768226:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768237:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:1.0:1782224278.768240:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224278.768244:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768250:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876600/0xcfd8b3ae4b164f70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768262:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164f77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768268:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164f77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768274:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164f77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768279:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224278.768282:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164f77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768287:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164f77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768294:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96ea8508f300) 00010000:00010000:1.0:1782224278.768296:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224278.768298:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164f77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768312:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876200/0xcfd8b3ae4b164f77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768354:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99876c00/0xcfd8b3ae4b164f69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51695 expref: 30 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768430:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b164f7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51695 expref: 29 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.768439:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508fb00) 00010000:00010000:1.0:1782224278.768442:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782224278.768444:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d54000, rc 0) 00000100:00100000:1.0:1782224278.768557:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+29:10459:x1868797312022016:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1195us (1443us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1782224278.768565:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 92 00000100:00100000:0.0:1782224278.775328:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224278.775585:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312022144 00000100:00100000:3.0:1782224278.775606:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312022144 00000100:00100000:3.0:1782224278.775730:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 93 00000100:00100000:3.0:1782224278.775740:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+29:10459:x1868797312022144:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:3.0:1782224278.775800:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164f8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.775817:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f31 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51680 expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.775839:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164f8c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.775876:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51680 expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.775888:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51680 expref: 29 pid: 5786 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224278.775902:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333015296:192.168.202.7@tcp:104: 00000100:00100000:3.0:1782224278.776003:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabd0d43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782224278.778788:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333015296:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224278.778816:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164f8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224278.779330:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224278.779409:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312022400 00000100:00100000:1.0:1782224278.779415:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312022400 00000100:00100000:1.0:1782224278.779495:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:1.0:1782224278.779504:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+30:5563:x1868797312022400:12345-192.168.202.7@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1782224278.779835:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+31:5563:x1868797312022400:12345-192.168.202.7@tcp:35:ldlm_bl.0 Request processed in 318us (493us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1782224278.779842:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:0.0:1782224278.785152:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224278.785286:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312022528 00000100:00100000:3.0:1782224278.785295:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312022528 00010000:00010000:3.0:1782224278.785337:0:8291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51680 expref: 31 pid: 5786 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224278.785395:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:3.0:1782224278.785404:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+31:2346:x1868797312022528:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224278.785420:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224278.785427:0:8291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51680 expref: 31 pid: 5786 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.785439:0:8291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51680 expref: 31 pid: 5786 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.785464:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877c00/0xcfd8b3ae4b164f31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51680 expref: 31 pid: 5786 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.785482:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508fb00) 00010000:00010000:3.0:1782224278.785487:0:8291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164f8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.785496:0:8291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.785504:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164f8c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.785527:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224278.785582:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+30:2346:x1868797312022528:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 179us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224278.785589:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 48 00010000:00010000:1.0:1782224278.785805:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.785813:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.785859:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.785866:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164f8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.785872:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164f8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.785879:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224278.785882:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164f8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.785889:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164f8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.785898:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508fb00) 00010000:00010000:1.0:1782224278.785901:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782224278.785904:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164f8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.785910:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164f8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224278.786092:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+29:10459:x1868797312022144:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 10353us (10773us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224278.786100:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 93 00000100:00100000:0.0:1782224278.788715:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224278.790282:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312022784 00000100:00100000:3.0:1782224278.791154:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312022784 00000100:00100000:3.0:1782224278.791218:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:3.0:1782224278.791230:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+29:10459:x1868797312022784:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1782224278.791456:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+30:10459:x1868797312022784:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 229us (2750us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1782224278.791462:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:0.0:1782224278.890386:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224278.890481:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312023040 00000100:00100000:1.0:1782224278.890491:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312023040 00000100:00100000:1.0:1782224278.890545:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 94 00000100:00100000:1.0:1782224278.890567:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+30:10470:x1868797312023040:12345-192.168.202.7@tcp:101:cat.0 00010000:00010000:1.0:1782224278.890594:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224278.890644:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b164f93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5169c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.890723:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164f9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.890739:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.890751:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.890763:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.890770:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.890775:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891108:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b164fa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891117:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b164fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891123:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b164fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224278.891140:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1782224278.891232:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891240:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164f9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891248:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164f9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891254:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224278.891259:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164f9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891267:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164f9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891281:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:1.0:1782224278.891283:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224278.891289:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164f9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891294:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164f9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891308:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891313:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891326:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891331:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224278.891334:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891339:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891345:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96ea8508f300) 00010000:00010000:1.0:1782224278.891346:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224278.891349:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fa1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891353:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891397:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b164f93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5169c expref: 33 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891409:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b164fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5169c expref: 32 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.891416:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508fb00) 00010000:00010000:1.0:1782224278.891417:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782224278.891419:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d55a00, rc 0) 00000100:00100000:1.0:1782224278.891501:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+32:10470:x1868797312023040:12345-192.168.202.7@tcp:101:cat.0 Request processed in 936us (1125us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1782224278.891516:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 94 00000100:00100000:3.0:1782224278.900492:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224278.900597:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312023296 00000100:00100000:1.0:1782224278.900617:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312023296 00000100:00100000:1.0:1782224278.900675:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00100000:1.0:1782224278.900685:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+32:10470:x1868797312023296:12345-192.168.202.7@tcp:35:cat.0 00000100:00100000:1.0:1782224278.900945:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+33:10470:x1868797312023296:12345-192.168.202.7@tcp:35:cat.0 Request processed in 260us (463us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1782224278.900953:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00100000:2.0:1782224278.933722:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224278.933819:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312023552 00000100:00100000:1.0:1782224278.933839:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312023552 00000100:00100000:1.0:1782224278.933902:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 95 00000100:00100000:1.0:1782224278.933913:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+33:10471:x1868797312023552:12345-192.168.202.7@tcp:36:rm.0 00010000:00010000:1.0:1782224278.933972:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782224278.934000:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b164fa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5169c expref: 33 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.934071:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b164f7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51695 expref: 32 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.934085:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b164f46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51687 expref: 31 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.934100:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508fb00) 00010000:00010000:1.0:1782224278.934111:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782224278.934131:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b164fb6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.934163:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b164fb6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.934174:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b164fb6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.934190:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.934198:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.934205:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.934492:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164fc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.934500:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164fc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.934508:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164fc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782224278.935142:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1782224278.935153:0:6605:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359715137058ns, next at 360715134902ns, rc = 0 00010000:00010000:1.0:1782224278.935211:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b164fcb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935222:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b164fcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935240:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b164fcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935249:0:6605:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b164fcb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935256:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b164fcb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935262:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b164fcb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935288:0:6605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782224278.935306:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164fc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935313:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164fc4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935319:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164fc4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935326:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224278.935331:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164fc4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935338:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164fc4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935350:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508f900) 00010000:00010000:1.0:1782224278.935353:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782224278.935363:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164fc4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935370:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b164fc4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935386:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b164fb6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935393:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b164fb6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935399:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b164fb6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935405:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55000 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224278.935409:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b164fb6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935415:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b164fb6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935424:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:1.0:1782224278.935426:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224278.935430:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b164fb6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224278.935436:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b164fb6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782224278.935445:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000032c2708 reply state 0000000075485fa3 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224278.935465:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782224278.935554:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+32:10471:x1868797312023552:12345-192.168.202.7@tcp:36:rm.0 Request processed in 1641us (1840us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1782224278.935563:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 95 00010000:00010000:2.0:1782224278.935801:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782224278.935808:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b164fcb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.935831:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55c00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:2.0:1782224278.935834:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b164fcb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.935842:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b164fcb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.935851:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96ea8508f900) 00010000:00010000:2.0:1782224278.935854:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782224278.935857:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b164fcb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.935863:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b164fcb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224278.935878:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224278.935880:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224278.935882:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224278.938379:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.938397:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.938405:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.938411:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224278.938414:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.938421:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fbd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.938437:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96ea8508f300) 00010000:00010000:3.0:1782224278.938440:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224278.938444:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fbd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224278.938449:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b164fbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224279.022035:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224279.022225:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312023808 00000100:00100000:3.0:1782224279.022234:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312023808 00000100:00100000:3.0:1782224279.022285:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 96 00000100:00100000:3.0:1782224279.022294:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+31:10477:x1868797312023808:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:3.0:1782224279.022317:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224279.022335:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164fd2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a516a3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.022437:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164fd9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.022450:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164fd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.022458:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164fd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.022467:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164fe0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.022472:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.022475:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782224279.023342:0:5787:0:(osp_object.c:1673:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1782224279.023492:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164fe7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.023513:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.023521:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.023551:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164fd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.023557:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164fd9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.023563:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164fd9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.023569:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224279.023573:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164fd9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.023579:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164fd9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.023589:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:3.0:1782224279.023592:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224279.023595:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164fd9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.024915:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b164fd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782224279.024939:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000768bc2f7 reply state 0000000013958750 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224279.024961:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782224279.025004:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b164fd2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516a3 expref: 34 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.025102:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516a3 expref: 33 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.025111:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7a00) 00010000:00010000:3.0:1782224279.025113:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782224279.025116:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674e00, rc 0) 00000100:00100000:3.0:1782224279.025382:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+34:10477:x1868797312023808:12345-192.168.202.7@tcp:101:bash.0 Request processed in 3089us (3376us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1782224279.025389:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 96 00000100:00100000:0.0:1782224279.030548:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224279.032297:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312023936 00000100:00100000:1.0:1782224279.032310:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312023936 00000100:00100000:1.0:1782224279.032377:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 34 00000100:00100000:1.0:1782224279.032386:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2349:x1868797312023936:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1782224279.032404:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224279.032424:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c02aad30/0xcfd8b3ae4b164ff5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a516aa expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782224279.032449:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224279.032466:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=359s v=(0 0) 00010000:00010000:1.0:1782224279.032471:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224279.032480:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c02aad30/0xcfd8b3ae4b164ff5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516aa expref: 8 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.032498:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c02aad30/0xcfd8b3ae4b164ff5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516aa expref: 8 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.032510:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d54c00, rc 0) 00000100:00100000:1.0:1782224279.032569:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2349:x1868797312023936:12345-192.168.202.7@tcp:101:bash.0 Request processed in 183us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224279.032576:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 34 00010000:00010000:3.0:1782224279.036394:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.036413:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164fe0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.036422:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164fe0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.036429:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224279.036434:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164fe0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.036441:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164fe0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.036479:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96ea87df7800) 00010000:00010000:3.0:1782224279.036482:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224279.036487:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164fe0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.036493:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b164fe0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224279.041758:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224279.042006:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312024064 00000100:00100000:0.0:1782224279.042033:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312024064 00000100:00100000:0.0:1782224279.042094:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 35 00000100:00100000:0.0:1782224279.042105:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:10477:x1868797312024064:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:0.0:1782224279.042131:0:6585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224279.042150:0:6585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b164ffc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a516b1 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.042181:0:6585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c02aad30/0xcfd8b3ae4b164ff5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516aa expref: 9 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.042191:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224279.042195:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224279.042213:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b164ffc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b1 expref: 9 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.042246:0:6585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c02aad30/0xcfd8b3ae4b164ff5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516aa expref: 9 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.042260:0:6585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c02aad30/0xcfd8b3ae4b164ff5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516aa expref: 9 pid: 6584 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224279.042274:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d21c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6585:1868797333015424:192.168.202.7@tcp:104: 00000100:00100000:0.0:1782224279.042361:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea828fee40 going to sleep for 11 seconds 00000100:00100000:0.0:1782224279.050945:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d21c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6585:1868797333015424:192.168.202.7@tcp:104: 00010000:00010000:0.0:1782224279.050986:0:6585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b164ffc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b1 expref: 9 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.051007:0:6585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74a00, rc 0) 00000100:00100000:0.0:1782224279.051094:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:10477:x1868797312024064:12345-192.168.202.7@tcp:101:bash.0 Request processed in 8990us (9345us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224279.051103:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 35 00000100:00100000:3.0:1782224279.057346:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224279.057534:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312024192 00000100:00100000:2.0:1782224279.057544:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312024192 00010000:00010000:2.0:1782224279.057581:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c02aad30/0xcfd8b3ae4b164ff5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516aa expref: 9 pid: 6584 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224279.057630:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:2.0:1782224279.057640:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea860b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:2347:x1868797312024192:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782224279.057657:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224279.057688:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c02aad30/0xcfd8b3ae4b164ff5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516aa expref: 9 pid: 6584 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224279.057717:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c02aad30/0xcfd8b3ae4b164ff5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516aa expref: 9 pid: 6584 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224279.057741:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c02aad30/0xcfd8b3ae4b164ff5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516aa expref: 9 pid: 6584 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224279.057758:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782224279.057762:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782224279.057769:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b164ffc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b1 expref: 8 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224279.057779:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b164ffc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b1 expref: 8 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224279.058407:0:5772:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b164ffc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b1 expref: 8 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224279.058425:0:5772:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc01e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5772:1868797333015552:192.168.202.7@tcp:105: 00000100:00100000:2.0:1782224279.058515:0:5772:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832ed0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224279.065778:0:5772:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc01e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5772:1868797333015552:192.168.202.7@tcp:105: 00010000:00010000:2.0:1782224279.065805:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224279.066183:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea860b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2347:x1868797312024192:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 8542us (8844us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224279.066194:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:3.0:1782224279.066547:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224279.066594:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312024448 00000100:00100000:1.0:1782224279.066602:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312024448 00000100:00100000:1.0:1782224279.066664:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 25 00000100:00100000:1.0:1782224279.066674:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+33:10477:x1868797312024448:12345-192.168.202.7@tcp:35:bash.0 00000100:00100000:0.0:1782224279.067285:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+34:10477:x1868797312024448:12345-192.168.202.7@tcp:35:bash.0 Request processed in 609us (736us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1782224279.067294:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 25 00000001:00080000:2.0:1782224279.180306:0:6608:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:2.0:1782224279.180320:0:6608:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:2.0:1782224279.180325:0:6608:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1782224279.253679:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224279.270091:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224279.270684:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312024576 00000100:00100000:3.0:1782224279.270696:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312024576 00000100:00100000:3.0:1782224279.270781:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 97 00000100:00100000:3.0:1782224279.270793:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+34:10493:x1868797312024576:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1782224279.271122:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224279.271152:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165003 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a516b8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.271473:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b16500a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.271489:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b16500a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.271527:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b16500a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224279.271602:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1782224279.271618:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782224279.271645:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b16500a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.271679:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165003 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b8 expref: 36 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.271704:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b16500a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b8 expref: 35 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.271907:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:0.0:1782224279.271911:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782224279.271914:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a75c00, rc 0) 00000100:00100000:0.0:1782224279.271977:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+35:10493:x1868797312024576:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1186us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224279.271983:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 97 00000100:00100000:1.0:1782224279.278700:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224279.281265:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312024832 00000100:00100000:0.0:1782224279.281279:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312024832 00000100:00100000:0.0:1782224279.281362:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 98 00000100:00100000:0.0:1782224279.281372:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+35:10493:x1868797312024832:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1782224279.281393:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224279.281413:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b165011 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a516bf expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.281530:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b165018 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.281545:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b165018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.281555:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b165018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224279.281566:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1782224279.281913:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b165011 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516bf expref: 38 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.281936:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b165018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516bf expref: 37 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.281944:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7a00) 00010000:00010000:0.0:1782224279.281947:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782224279.281950:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74c00, rc 0) 00000100:00100000:0.0:1782224279.282154:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+37:10493:x1868797312024832:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 781us (3462us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1782224279.282163:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 98 00000100:00100000:3.0:1782224279.286677:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224279.287174:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312024960 00000100:00100000:2.0:1782224279.287185:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312024960 00000100:00100000:2.0:1782224279.287254:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:2.0:1782224279.287265:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+37:2347:x1868797312024960:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782224279.287281:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224279.287305:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b165018 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516bf expref: 37 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224279.287325:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7a00) 00010000:00010000:2.0:1782224279.287329:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224279.288456:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224279.288642:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312025216 00000100:00100000:3.0:1782224279.288649:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312025216 00000100:00100000:3.0:1782224279.288702:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 99 00000100:00100000:3.0:1782224279.288712:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+37:10493:x1868797312025216:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1782224279.288735:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224279.288753:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165026 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a516c6 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.289092:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16502d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.289108:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16502d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.289120:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16502d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224279.289132:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1782224279.289261:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165026 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516c6 expref: 40 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.289281:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16502d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516c6 expref: 39 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.289290:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7a00) 00010000:00010000:3.0:1782224279.289293:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1782224279.289296:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674600, rc 0) 00000100:00100000:3.0:1782224279.289356:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+39:10493:x1868797312025216:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 646us (905us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1782224279.289364:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 99 00000100:00100000:2.0:1782224279.289548:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+38:2347:x1868797312024960:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 2282us (2879us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224279.289557:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:3.0:1782224279.306230:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224279.306296:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312025344 00000100:00100000:1.0:1782224279.306306:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312025344 00000100:00100000:1.0:1782224279.306367:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00100000:1.0:1782224279.306376:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2349:x1868797312025344:12345-192.168.202.7@tcp:1:lfs.0 00010000:00010000:1.0:1782224279.306419:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f40cdef/0xcfd8b3ae4b16503b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.306442:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b164ffc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b1 expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.306450:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782224279.306454:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782224279.306459:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f40cdef/0xcfd8b3ae4b16503b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.306495:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b164ffc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b1 expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.306510:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b164ffc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b1 expref: 6 pid: 6585 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224279.306547:0:6584:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabccbb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6584:1868797333015680:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224279.306782:0:6584:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaadb39480 going to sleep for 11 seconds 00000100:00100000:3.0:1782224279.310566:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224279.310935:0:6584:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabccbb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6584:1868797333015680:192.168.202.7@tcp:104: 00010000:00010000:1.0:1782224279.310959:0:6584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002f40cdef/0xcfd8b3ae4b16503b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224279.311179:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312025472 00000100:00100000:0.0:1782224279.311187:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312025472 00002000:00100000:0.0:1782224279.311234:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff96eabc550000 x1868797312025472/t0(0) o4->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:735/0 lens 504/0 e 0 to 0 dl 1782224290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782224279.311244:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96eabc550000 with x1868797312025472 ext(0->8) 00010000:00010000:0.0:1782224279.311267:0:6590:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b164ffc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b1 expref: 7 pid: 6585 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.311282:0:6590:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b164ffc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b1 expref: 7 pid: 6585 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782224279.311290:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff96eabc550000 00000100:00100000:0.0:1782224279.311455:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:1.0:1782224279.311465:0:6589:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1782224279.311468:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312025472:12345-192.168.202.7@tcp:4:lfs.0 00000100:00100000:1.0:1782224279.311473:0:6589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1782224279.312757:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:2346:x1868797312025472:12345-192.168.202.7@tcp:4:lfs.0 Request processed in 1286us (2194us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1782224279.312774:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 1 00002000:00100000:1.0:1782224279.312783:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff96eabc550000 x1868797312025472/t4294967302(0) o4->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:735/0 lens 504/448 e 0 to 0 dl 1782224290 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782224279.312789:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96eabc550000 with x1868797312025472 ext(0->8) 00010000:00010000:1.0:1782224279.312797:0:6590:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b164ffc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b1 expref: 9 pid: 6585 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.312818:0:6590:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b164ffc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b1 expref: 9 pid: 6585 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782224279.312826:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff96eabc550000 00000100:00100000:2.0:1782224279.315379:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224279.315480:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312025600 00000100:00100000:3.0:1782224279.315490:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312025600 00010000:00010000:3.0:1782224279.315527:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b164ffc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b1 expref: 9 pid: 6585 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224279.315623:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 50 00000100:00100000:3.0:1782224279.315634:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:2346:x1868797312025600:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224279.315650:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1782224279.315669:0:5770:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1782224279.315672:0:5770:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782224278 00002000:00010000:3.0:1782224279.315674:0:5770:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1782224279 00002000:00010000:3.0:1782224279.315676:0:5770:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1782224278 00010000:00010000:3.0:1782224279.315683:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b164ffc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b1 expref: 9 pid: 6585 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.315698:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b164ffc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b1 expref: 9 pid: 6585 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.315724:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b164ffc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b1 expref: 9 pid: 6585 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.315742:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782224279.315746:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782224279.315751:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f40cdef/0xcfd8b3ae4b16503b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.315760:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f40cdef/0xcfd8b3ae4b16503b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.315795:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224279.315860:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2346:x1868797312025600:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 227us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224279.315867:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 50 00010000:00010000:1.0:1782224279.316222:0:6584:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002f40cdef/0xcfd8b3ae4b16503b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.316245:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f40cdef/0xcfd8b3ae4b16503b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.316273:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f40cdef/0xcfd8b3ae4b16503b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.316283:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f40cdef/0xcfd8b3ae4b16503b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.316291:0:6584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f40cdef/0xcfd8b3ae4b16503b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.316298:0:6584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224279.316302:0:6584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f40cdef/0xcfd8b3ae4b16503b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.316311:0:6584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f40cdef/0xcfd8b3ae4b16503b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.316323:0:6584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f40cdef/0xcfd8b3ae4b16503b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.316330:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f40cdef/0xcfd8b3ae4b16503b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224279.316651:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2349:x1868797312025344:12345-192.168.202.7@tcp:1:lfs.0 Request processed in 10274us (10428us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224279.316660:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00100000:2.0:1782224279.319398:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224279.319553:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312025856 00000100:00100000:0.0:1782224279.319562:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312025856 00000100:00100000:0.0:1782224279.319688:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 26 00000100:00100000:0.0:1782224279.319699:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea9c44ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+38:10493:x1868797312025856:12345-192.168.202.7@tcp:35:lfs.0 00000004:00010000:0.0:1782224279.319758:0:5790:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16502d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516c6 expref: 38 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782224279.322198:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1782224279.322280:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1782224279.322637:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1782224279.322762:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165042 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.322785:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164fe7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516a3 expref: 42 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.322795:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165042 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.322858:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516a3 expref: 42 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.322878:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164fe7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516a3 expref: 42 pid: 5787 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224279.322896:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d21c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5790:1868797333015808:192.168.202.7@tcp:104: 00000100:00100000:0.0:1782224279.323144:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224279.327887:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d21c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5790:1868797333015808:192.168.202.7@tcp:104: 00010000:00010000:0.0:1782224279.327921:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165042 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224279.334982:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224279.335053:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312025984 00000100:00100000:0.0:1782224279.335076:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312025984 00010000:00010000:0.0:1782224279.335120:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164fe7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516a3 expref: 43 pid: 5787 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224279.335163:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:0.0:1782224279.335173:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+43:2346:x1868797312025984:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224279.335198:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224279.335206:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164fe7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516a3 expref: 43 pid: 5787 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.335219:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516a3 expref: 43 pid: 5787 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.335260:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b164fe7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516a3 expref: 43 pid: 5787 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.335280:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7a00) 00010000:00010000:0.0:1782224279.335286:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165042 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.335295:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165042 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.335302:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165042 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.335387:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224279.335441:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+42:2346:x1868797312025984:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 268us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224279.335449:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 51 00010000:00010000:1.0:1782224279.335618:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165042 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.335628:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165042 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782224279.335774:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1782224279.336002:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1782224279.336457:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabccbb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1868797333015936:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782224279.336514:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224279.336538:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea84f6a480 going to sleep for 11 seconds 00000100:00100000:0.0:1782224279.336593:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333015936 00000100:00100000:0.0:1782224279.336598:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333015936 00000100:00100000:0.0:1782224279.336716:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782224279.336726:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5790:x1868797333015936:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782224279.336798:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5790:x1868797333015936:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 74us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224279.336805:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224279.336873:0:5790:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1782224279.336880:0:5790:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1782224279.336902:0:5790:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96e9879d7800, transno 4294967301 00000100:00100000:1.0:1782224279.336923:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabccbb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1868797333015936:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1782224279.337570:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1782224279.337639:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabccbb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1868797333016064:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782224279.337735:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224279.337846:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaadb39480 going to sleep for 11 seconds 00000100:00100000:0.0:1782224279.337887:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333016064 00000100:00100000:0.0:1782224279.337893:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333016064 00000100:00100000:0.0:1782224279.337967:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782224279.337976:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5790:x1868797333016064:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782224279.338362:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5790:x1868797333016064:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 386us (625us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1782224279.338371:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1782224279.338672:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782224279.339344:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabccbb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1868797333016064:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1782224279.339423:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1782224279.339473:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165042 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.339484:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165042 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.339492:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165042 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.339498:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224279.339503:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165042 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.339510:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165042 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.339527:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7a00) 00010000:00010000:3.0:1782224279.339530:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1782224279.339535:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165042 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.339542:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165042 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782224279.339765:0:5790:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1782224279.340495:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1782224279.340522:0:5790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360120506148ns, next at 361120503419ns, rc = 0 00000001:00080000:3.0:1782224279.340532:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1782224279.340576:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7a00) 00010000:00010000:3.0:1782224279.340579:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1782224279.340589:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16502d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516c6 expref: 46 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224279.340730:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea9c44ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+45:10493:x1868797312025856:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 21032us (21339us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1782224279.340738:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 26 00000020:00080000:3.0:1782224279.340744:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1782224279.345636:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224279.346248:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312026112 00000100:00100000:3.0:1782224279.346262:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312026112 00000100:00100000:3.0:1782224279.346324:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 100 00000100:00100000:3.0:1782224279.346335:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+45:10493:x1868797312026112:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1782224279.346364:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224279.346389:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165049 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a516cd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.346450:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165049 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516cd expref: 46 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.346467:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165049 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516cd expref: 46 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.346490:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:3.0:1782224279.346494:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782224279.346497:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675c00, rc 0) 00000100:00100000:3.0:1782224279.346587:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+46:10493:x1868797312026112:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 254us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224279.346594:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 100 00000100:00100000:2.0:1782224279.353392:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224279.353466:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312026368 00000100:00100000:0.0:1782224279.353476:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312026368 00000100:00100000:0.0:1782224279.353542:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:0.0:1782224279.353553:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+46:10493:x1868797312026368:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:0.0:1782224279.353912:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+47:10493:x1868797312026368:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 361us (531us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1782224279.353921:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:1.0:1782224279.471334:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224279.471390:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312026496 00000100:00100000:0.0:1782224279.471400:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312026496 00000100:00100000:0.0:1782224279.471517:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 101 00000100:00100000:0.0:1782224279.471536:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+47:10503:x1868797312026496:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:0.0:1782224279.471641:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165050 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.471666:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.471682:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.471698:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165057 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.471705:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.471739:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472116:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16505e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472195:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16505e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472206:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16505e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782224279.472270:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16505e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472291:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472298:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165050 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472309:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165050 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472317:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224279.472321:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165050 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472329:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165050 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472351:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:0.0:1782224279.472361:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224279.472373:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165050 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472379:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165050 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472398:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472404:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165057 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472409:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472414:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224279.472417:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472427:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165057 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472434:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96eaa7d65100) 00010000:00010000:0.0:1782224279.472436:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224279.472439:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165057 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472444:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165057 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472463:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16505e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472474:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16505e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472485:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16505e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472490:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224279.472493:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16505e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472498:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16505e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472506:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:0.0:1782224279.472508:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224279.472516:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16505e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.472523:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16505e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224279.472624:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+47:10503:x1868797312026496:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 1089us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224279.472632:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 101 00000100:00100000:2.0:1782224279.524278:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224279.524762:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312026752 00000100:00100000:3.0:1782224279.524773:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312026752 00000100:00100000:3.0:1782224279.524846:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 102 00000100:00100000:3.0:1782224279.524855:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+47:10506:x1868797312026752:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1782224279.524874:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224279.524894:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165065 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a516d4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.524984:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16506c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.524998:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16506c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525009:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16506c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525051:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165073 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525058:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525064:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525199:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16507a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525218:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16507a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525225:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16507a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224279.525235:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1782224279.525330:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16506c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525338:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16506c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525735:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16506c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525741:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224279.525746:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16506c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525754:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16506c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525765:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:3.0:1782224279.525769:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224279.525773:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16506c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525780:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16506c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525796:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525886:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165073 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525892:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165073 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525897:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224279.525900:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165073 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525906:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165073 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525913:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96ea87df7a00) 00010000:00010000:3.0:1782224279.525916:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224279.525918:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165073 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525924:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165073 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525966:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165065 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516d4 expref: 50 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525979:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16507a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516d4 expref: 49 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.525986:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:3.0:1782224279.525988:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782224279.525995:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674e00, rc 0) 00000100:00100000:3.0:1782224279.526144:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+49:10506:x1868797312026752:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1289us (1875us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1782224279.526152:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 102 00000100:00100000:2.0:1782224279.532187:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224279.532267:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312026880 00000100:00100000:3.0:1782224279.532276:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312026880 00000100:00100000:3.0:1782224279.532334:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 103 00000100:00100000:3.0:1782224279.532351:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+49:10506:x1868797312026880:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:3.0:1782224279.532417:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165088 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.532433:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.532444:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.532469:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.532475:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165088 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.532481:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.532487:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224279.532491:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.532498:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165088 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.532523:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:3.0:1782224279.532526:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782224279.532530:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165088 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.532535:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165088 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224279.532615:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+49:10506:x1868797312026880:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 273us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224279.532622:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 103 00000100:00100000:1.0:1782224279.539515:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224279.539565:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312027136 00000100:00100000:3.0:1782224279.539575:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312027136 00000100:00100000:0.0:1782224279.539710:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 28 00000100:00100000:0.0:1782224279.539724:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+49:10506:x1868797312027136:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1782224279.539762:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1782224279.539772:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1782224279.539969:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+50:10506:x1868797312027136:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 248us (466us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1782224279.539994:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 28 00000040:00080000:3.0:1782224279.636759:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782224279.636780:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782224279.636819:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782224279.636826:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782224279.654729:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224279.654840:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312027392 00000100:00100000:0.0:1782224279.654850:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312027392 00000100:00100000:0.0:1782224279.654912:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 104 00000100:00100000:0.0:1782224279.654932:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+50:10516:x1868797312027392:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:0.0:1782224279.654956:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224279.654958:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782224279.654992:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b16500a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516b8 expref: 50 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.655063:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:0.0:1782224279.655069:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782224279.655083:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16508f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a516db expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.655190:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165096 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.655203:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.655212:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224279.655221:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1782224279.655356:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16508f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516db expref: 52 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.655388:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516db expref: 51 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.655395:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:0.0:1782224279.655398:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782224279.655401:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74400, rc 0) 00000100:00100000:0.0:1782224279.655477:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+51:10516:x1868797312027392:12345-192.168.202.7@tcp:101:bash.0 Request processed in 556us (758us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1782224279.655484:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 104 00000100:00100000:3.0:1782224279.665167:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224279.665320:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312027648 00000100:00100000:1.0:1782224279.665331:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312027648 00000100:00100000:1.0:1782224279.665419:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 105 00000100:00100000:1.0:1782224279.665430:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+51:10516:x1868797312027648:12345-192.168.202.7@tcp:36:bash.0 00010000:00010000:1.0:1782224279.665491:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782224279.665519:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165096 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516db expref: 51 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.665541:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16507a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516d4 expref: 50 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.665555:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:1.0:1782224279.665560:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782224279.665777:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1650a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.665792:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1650a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.665802:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1650a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782224279.665851:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1782224279.665876:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000283e739b reply state 000000001c8a597b transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1650a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224279.665886:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782224279.666309:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:10516:x1868797312027648:12345-192.168.202.7@tcp:36:bash.0 Request processed in 880us (1150us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1782224279.666318:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 105 00000020:00080000:1.0:1782224279.666323:0:6605:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782224279.676648:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1650a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.676674:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1650a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.676683:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1650a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.676689:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224279.676708:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1650a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.676716:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1650a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.676734:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:3.0:1782224279.676737:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224279.676741:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1650a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.676748:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1650a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224279.678249:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224279.678372:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312027776 00000100:00100000:0.0:1782224279.678382:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312027776 00000100:00100000:0.0:1782224279.678440:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 106 00000100:00100000:0.0:1782224279.678451:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+51:10516:x1868797312027776:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:0.0:1782224279.678477:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224279.678495:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b1650ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a516e2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.678574:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.678587:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.678598:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224279.678640:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1782224279.678654:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782224279.678677:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.678703:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b1650ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516e2 expref: 53 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.678720:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516e2 expref: 52 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.678729:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:0.0:1782224279.678732:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782224279.678735:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a75c00, rc 0) 00000100:00100000:0.0:1782224279.678801:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:10516:x1868797312027776:12345-192.168.202.7@tcp:101:bash.0 Request processed in 352us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224279.678809:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 106 00000100:00100000:2.0:1782224279.681763:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224279.681836:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312028032 00000100:00100000:0.0:1782224279.681845:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312028032 00000100:00100000:0.0:1782224279.681895:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 29 00000100:00100000:0.0:1782224279.681903:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:10516:x1868797312028032:12345-192.168.202.7@tcp:35:bash.0 00000100:00100000:0.0:1782224279.682171:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+53:10516:x1868797312028032:12345-192.168.202.7@tcp:35:bash.0 Request processed in 267us (415us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1782224279.682177:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 29 00000100:00100000:2.0:1782224279.786002:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224279.786117:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312028160 00000100:00100000:0.0:1782224279.786129:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312028160 00000100:00100000:0.0:1782224279.786196:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 107 00000100:00100000:0.0:1782224279.786208:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+53:10522:x1868797312028160:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1782224279.786232:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224279.786261:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b1650b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a516e9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.786330:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b1650c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.786344:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b1650c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.786354:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b1650c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224279.786418:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1782224279.786422:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782224279.786447:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b1650c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.786471:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b1650b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516e9 expref: 55 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.786489:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b1650c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516e9 expref: 54 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.786497:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:0.0:1782224279.786500:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782224279.786504:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a75a00, rc 0) 00000100:00100000:0.0:1782224279.786566:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:10522:x1868797312028160:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 361us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224279.786574:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 107 00000100:00100000:2.0:1782224279.793421:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224279.793499:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312028288 00000100:00100000:0.0:1782224279.793524:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312028288 00000100:00100000:0.0:1782224279.793590:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 108 00000100:00100000:0.0:1782224279.793610:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:10522:x1868797312028288:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1782224279.793634:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224279.793658:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b1650c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a516f0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.793731:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1650ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.793746:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1650ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.793757:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1650ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.793775:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b1650d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.793783:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b1650d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.793789:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b1650d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.793889:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b1650dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.793899:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b1650dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.793906:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b1650dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224279.793956:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1782224279.793960:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782224279.793980:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b1650dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.793992:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b1650dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.794001:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1650ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.794007:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1650ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.794040:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1650ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.794047:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224279.794051:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1650ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.794058:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1650ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.794072:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:0.0:1782224279.794075:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224279.794079:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1650ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.794086:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1650ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.794111:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b1650d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.794117:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b1650d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.794122:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b1650d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.794127:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74000 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224279.794130:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b1650d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.794135:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b1650d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.794143:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96eaa7d65100) 00010000:00010000:0.0:1782224279.794146:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224279.794149:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b1650d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.794154:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b1650d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.794185:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b1650c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516f0 expref: 56 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.794197:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b1650dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516f0 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.794215:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:0.0:1782224279.794217:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782224279.794220:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74c00, rc 0) 00000100:00100000:0.0:1782224279.794298:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:10522:x1868797312028288:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 699us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224279.794305:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 108 00000100:00100000:2.0:1782224279.798618:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224279.798776:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224279.800755:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312028672 00000100:00100000:3.0:1782224279.800770:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312028672 00000100:00100000:3.0:1782224279.800851:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:3.0:1782224279.800861:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:2347:x1868797312028672:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224279.800877:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224279.800901:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b1650dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516f0 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.800922:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:3.0:1782224279.800926:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224279.800983:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:2347:x1868797312028672:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 124us (2207us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224279.800991:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:1.0:1782224279.802389:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312028544 00000100:00100000:1.0:1782224279.802411:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312028544 00000100:00100000:1.0:1782224279.802763:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 109 00000100:00100000:1.0:1782224279.802775:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:10522:x1868797312028544:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1782224279.802798:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224279.802830:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55600/0xcfd8b3ae4b1650e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a516f7 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.802937:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b1650ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.802953:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516e2 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.802962:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b1650ea lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.802996:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516e2 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.803011:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516e2 expref: 55 pid: 5786 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224279.803047:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabccbb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1868797333016192:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224279.803141:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905f2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782224279.809389:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224279.809453:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312028800 00000100:00100000:0.0:1782224279.809462:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312028800 00010000:00010000:0.0:1782224279.809503:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650b2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516e2 expref: 56 pid: 5786 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224279.809526:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabccbb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1868797333016192:192.168.202.7@tcp:104: 00000100:00100000:0.0:1782224279.809546:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 52 00010000:00010000:1.0:1782224279.809552:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b1650ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224279.809556:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+56:2346:x1868797312028800:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224279.809570:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224279.809577:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516e2 expref: 56 pid: 5786 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.809588:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516e2 expref: 56 pid: 5786 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.809626:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516e2 expref: 56 pid: 5786 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.809643:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:0.0:1782224279.809675:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b1650ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.809711:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b1650ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.809720:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b1650ea lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.809749:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782224279.809767:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b1650ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.809780:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b1650ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224279.809810:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:2346:x1868797312028800:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 257us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224279.809819:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 52 00000004:00200000:1.0:1782224279.809866:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1782224279.810063:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55600/0xcfd8b3ae4b1650e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516f7 expref: 56 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.810080:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b1650ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516f7 expref: 55 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.810089:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:1.0:1782224279.810092:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782224279.810094:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d55e00, rc 0) 00000100:00100000:1.0:1782224279.810135:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:10522:x1868797312028544:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 7363us (11537us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1782224279.810144:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 109 00000100:00100000:2.0:1782224279.815055:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224279.815172:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312029056 00000100:00100000:3.0:1782224279.815193:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312029056 00000100:00100000:3.0:1782224279.815250:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:3.0:1782224279.815260:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:10522:x1868797312029056:12345-192.168.202.7@tcp:103:lfs.0 00010000:00010000:3.0:1782224279.815278:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224279.815301:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165049 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516cd expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224279.815323:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:3.0:1782224279.815328:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224279.815393:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:10522:x1868797312029056:12345-192.168.202.7@tcp:103:lfs.0 Request processed in 134us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224279.815400:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:2.0:1782224279.825102:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224279.825664:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312029184 00000100:00100000:0.0:1782224279.825676:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312029184 00000100:00100000:0.0:1782224279.825990:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 110 00000100:00100000:0.0:1782224279.826003:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:10522:x1868797312029184:12345-192.168.202.7@tcp:58:lfs.0 00010000:00010000:0.0:1782224279.826165:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.826183:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224279.826195:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782224279.826521:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1782224279.826625:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:10522:x1868797312029184:12345-192.168.202.7@tcp:58:lfs.0 Request processed in 624us (1532us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224279.827512:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 110 00000100:00100000:0.0:1782224279.837336:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224279.837534:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312029312 00000100:00100000:1.0:1782224279.837545:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312029312 00000100:00100000:1.0:1782224279.837661:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 111 00000100:00100000:1.0:1782224279.837681:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:10522:x1868797312029312:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1782224279.837706:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224279.837727:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55600/0xcfd8b3ae4b1650ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a516fe expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.837790:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650f8 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.837813:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55600/0xcfd8b3ae4b1650ff lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516fe expref: 55 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.837829:0:5788:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.837843:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55600/0xcfd8b3ae4b1650ff lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516fe expref: 55 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.837858:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:1.0:1782224279.837862:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782224279.837865:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55600/0xcfd8b3ae4b1650ff lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516fe expref: 55 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224279.837874:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d55600, rc 0) 00000100:00100000:1.0:1782224279.837941:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:10522:x1868797312029312:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 271us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224279.837946:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 111 00010000:00010000:2.0:1782224280.276169:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782224280.660366:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782224280.660377:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782224280.660434:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1782224280.660442:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782224280.660587:0:11523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11523:1868797333016320:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782224280.660751:0:11523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabd0d4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782224280.669342:0:11523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11523:1868797333016320:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782224280.671366:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224280.671865:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312029440 00000100:00100000:0.0:1782224280.671892:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312029440 00000100:00100000:0.0:1782224280.672413:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 112 00000100:00100000:0.0:1782224280.672425:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:10523:x1868797312029440:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782224280.672471:0:5787:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782224280.672611:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:10523:x1868797312029440:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 188us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224280.672619:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 112 00000100:00080000:2.0:1782224280.676931:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782224280.677674:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224280.678348:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312029568 00000100:00100000:3.0:1782224280.678362:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312029568 00000100:00100000:3.0:1782224280.678454:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 113 00000100:00100000:3.0:1782224280.678466:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:10523:x1868797312029568:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1782224280.678540:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165106 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.678557:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165106 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.678580:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165106 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.678872:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16510d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.678882:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16510d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.678889:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16510d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.678911:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165114 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.678918:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.678924:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224280.679207:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1782224280.679212:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782224280.679226:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679237:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165106 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679243:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165106 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679258:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165106 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679264:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224280.679268:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165106 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679275:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165106 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679286:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96ea87df7c00) 00010000:00010000:3.0:1782224280.679288:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224280.679292:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165106 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679298:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165106 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679313:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16510d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679319:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16510d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679324:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16510d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679328:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224280.679330:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16510d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679342:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16510d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679348:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff96ea87df7a00) 00010000:00010000:3.0:1782224280.679350:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224280.679352:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16510d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679357:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16510d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679371:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679377:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165114 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679382:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679387:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224280.679390:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679396:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165114 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679403:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:3.0:1782224280.679405:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224280.679408:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165114 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.679423:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165114 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224280.679879:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:10523:x1868797312029568:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 Request processed in 1413us (2208us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224280.679887:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 113 00000100:00100000:3.0:1782224280.683802:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224280.685303:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312029824 00000100:00100000:0.0:1782224280.685317:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312029824 00000100:00100000:0.0:1782224280.685390:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 114 00000100:00100000:0.0:1782224280.685402:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:10523:x1868797312029824:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782224280.685421:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224280.685553:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b16511b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51705 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.685669:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b165122 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.685685:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b165122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.685697:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b165122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224280.686309:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1782224280.686419:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b165122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.687679:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b165122 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.687687:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b165122 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.687693:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224280.687698:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b165122 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.690662:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b165122 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.690699:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:0.0:1782224280.690702:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782224280.690719:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b165122 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.690727:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b165122 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.692206:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b16511b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51705 expref: 57 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.692222:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96ea87df7c00) 00010000:00010000:0.0:1782224280.692225:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782224280.692229:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b16511b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51705 expref: 57 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.692242:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74000, rc 0) 00000100:00100000:0.0:1782224280.692339:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+56:10523:x1868797312029824:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 6939us (8544us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1782224280.692349:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 114 00000100:00100000:2.0:1782224280.705565:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224280.705731:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312029952 00000100:00100000:1.0:1782224280.705743:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312029952 00000100:00100000:1.0:1782224280.705823:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 115 00000100:00100000:1.0:1782224280.705836:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+56:10523:x1868797312029952:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782224280.705900:0:5788:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782224280.706307:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+56:10523:x1868797312029952:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 473us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224280.706316:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 115 00000100:00100000:2.0:1782224280.711641:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224280.712656:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312030208 00000100:00100000:1.0:1782224280.712669:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312030208 00000100:00100000:1.0:1782224280.712815:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 116 00000100:00100000:1.0:1782224280.712825:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+56:10523:x1868797312030208:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782224280.712851:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224280.712853:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782224280.712881:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b1650c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516e9 expref: 56 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.712902:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:1.0:1782224280.712907:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782224280.713292:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165130 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5170c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782224280.715604:0:5786:0:(osp_object.c:1673:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1782224280.718793:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b165137 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.718816:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b165137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.718828:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b165137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.718901:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165130 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5170c expref: 58 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.720051:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b165137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5170c expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.720081:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96ea8508fb00) 00010000:00010000:1.0:1782224280.720084:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782224280.720087:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d54200, rc 0) 00000100:00100000:1.0:1782224280.720343:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:10523:x1868797312030208:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 7517us (8710us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1782224280.720352:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 116 00000100:00100000:2.0:1782224280.727915:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224280.727999:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312030464 00000100:00100000:1.0:1782224280.728009:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312030464 00000100:00100000:1.0:1782224280.728122:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 117 00000100:00100000:1.0:1782224280.728134:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:10523:x1868797312030464:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782224280.728206:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224280.728231:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b165137 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5170c expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728250:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96ea8508fb00) 00010000:00010000:1.0:1782224280.728259:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782224280.728278:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165145 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728291:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165145 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728299:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165145 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728312:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b16514c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7bb726ba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728338:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b16514c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7bb726ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728345:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b16514c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7bb726ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728413:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165145 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728421:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165145 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728428:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165145 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728434:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224280.728439:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165145 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728447:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165145 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728455:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:1.0:1782224280.728458:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224280.728462:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165145 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728469:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165145 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728477:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b16514c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7bb726ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728488:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b16514c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7bb726ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728495:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b16514c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7bb726ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728500:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224280.728503:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b16514c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7bb726ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728509:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b16514c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7bb726ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728517:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7bb726ba (ffff96ea8508ff00) 00010000:00010000:1.0:1782224280.728520:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224280.728522:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b16514c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7bb726ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.728528:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b16514c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7bb726ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224280.728620:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+56:10523:x1868797312030464:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 487us (714us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782224280.728628:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 117 00000100:00100000:2.0:1782224280.730907:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224280.730993:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312030592 00000100:00100000:0.0:1782224280.731002:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312030592 00000100:00100000:0.0:1782224280.731092:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 118 00000100:00100000:0.0:1782224280.731102:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+56:10523:x1868797312030592:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782224280.731130:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224280.731161:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b165153 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51713 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.731194:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b16515a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.731206:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b16515a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.731218:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b16515a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.731313:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b165153 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51713 expref: 58 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.731332:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b16515a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51713 expref: 57 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.731341:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96eaa7d65100) 00010000:00010000:0.0:1782224280.731344:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782224280.731347:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74a00, rc 0) 00000100:00100000:0.0:1782224280.731403:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:10523:x1868797312030592:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 302us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224280.731410:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 118 00000100:00100000:0.0:1782224280.736640:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224280.736827:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312030848 00000100:00100000:1.0:1782224280.736839:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312030848 00000100:00100000:1.0:1782224280.736905:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 119 00000100:00100000:1.0:1782224280.736915:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:10523:x1868797312030848:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782224280.737006:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165161 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.737074:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.737086:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782224280.737359:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1782224280.737369:0:5788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361517353114ns, next at 362517350874ns, rc = 0 00000004:00010000:1.0:1782224280.737457:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005faba0dc reply state 000000000b7ef047 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224280.737466:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782224280.737574:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+59:10523:x1868797312030848:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 659us (943us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1782224280.737581:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 119 00010000:00010000:3.0:1782224280.740195:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.740213:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165161 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.740221:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165161 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.740226:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224280.740231:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165161 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.740241:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165161 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.740258:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96eaa7d65100) 00010000:00010000:3.0:1782224280.740261:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782224280.740264:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165161 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.740270:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165161 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224280.742517:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224280.742624:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312030976 00000100:00100000:1.0:1782224280.742637:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312030976 00000100:00100000:1.0:1782224280.742724:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 120 00000100:00100000:1.0:1782224280.742738:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+58:10523:x1868797312030976:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782224280.742773:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224280.742798:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165168 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5171a expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.742869:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165168 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5171a expref: 59 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.742887:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165168 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5171a expref: 59 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.742933:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96eaa7d65100) 00010000:00010000:1.0:1782224280.742937:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782224280.742940:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d54600, rc 0) 00000100:00100000:1.0:1782224280.743058:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+59:10523:x1868797312030976:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 323us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224280.743065:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 120 00000100:00100000:2.0:1782224280.746333:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224280.746480:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312031104 00000100:00100000:0.0:1782224280.746490:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312031104 00000100:00100000:0.0:1782224280.746565:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00100000:0.0:1782224280.746579:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2346:x1868797312031104:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1782224280.746933:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:2346:x1868797312031104:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 356us (610us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1782224280.746942:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00080000:2.0:1782224280.749707:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782224280.755506:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224280.755635:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312031360 00000100:00100000:2.0:1782224280.755646:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312031360 00000100:00100000:2.0:1782224280.755786:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 30 00000100:00100000:2.0:1782224280.755802:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+59:10523:x1868797312031360:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782224280.756713:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+60:10523:x1868797312031360:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 909us (1209us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1782224280.756724:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 30 00000100:00100000:1.0:1782224280.760513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224280.760653:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312031616 00000100:00100000:0.0:1782224280.760665:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312031616 00000100:00100000:0.0:1782224280.760840:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 121 00000100:00100000:0.0:1782224280.760853:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+60:10523:x1868797312031616:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782224280.760989:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+60:10523:x1868797312031616:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 138us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224280.760998:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 121 00000100:00100000:2.0:1782224280.767135:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224280.767275:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312031744 00000100:00100000:1.0:1782224280.767289:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312031744 00000100:00100000:1.0:1782224280.767360:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 122 00000100:00100000:1.0:1782224280.767371:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+60:10523:x1868797312031744:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782224280.767397:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224280.767419:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b16516f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51721 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.767501:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165176 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.767517:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.767529:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224280.767567:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782224280.767586:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.767648:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b16516f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51721 expref: 62 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.767666:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165176 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51721 expref: 61 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.767685:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96eaa7d65100) 00010000:00010000:1.0:1782224280.767688:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782224280.767692:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d55800, rc 0) 00000100:00100000:1.0:1782224280.767757:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+61:10523:x1868797312031744:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 388us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224280.767765:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 122 00000100:00100000:2.0:1782224280.771319:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224280.771504:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312031872 00000100:00100000:1.0:1782224280.771516:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312031872 00000100:00100000:1.0:1782224280.771615:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 38 00000100:00100000:1.0:1782224280.771635:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:2347:x1868797312031872:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782224280.771654:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224280.771695:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b16517d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51728 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782224280.771733:0:6715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a9598, blocks: 0x1 00010000:00010000:1.0:1782224280.771769:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1782224280.771787:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224280.771817:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b16517d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51728 expref: 10 pid: 6715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.771918:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b16517d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51728 expref: 10 pid: 6715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.771933:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d54200, rc 0) 00000100:00100000:1.0:1782224280.772000:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+10:2347:x1868797312031872:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 375us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224280.772008:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 38 00000100:00100000:3.0:1782224280.789544:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224280.789666:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312032128 00000100:00100000:1.0:1782224280.789688:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312032128 00000100:00100000:1.0:1782224280.789758:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 123 00000100:00100000:1.0:1782224280.789769:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+61:10523:x1868797312032128:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782224280.789907:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+61:10523:x1868797312032128:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 139us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224280.789915:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 123 00000100:00100000:3.0:1782224280.803319:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224280.803444:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312032256 00000100:00100000:0.0:1782224280.803456:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312032256 00000100:00100000:0.0:1782224280.803524:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:0.0:1782224280.803536:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+10:10523:x1868797312032256:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782224280.803558:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224280.803579:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165184 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5172f expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.803646:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b16517d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51728 expref: 11 pid: 6715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.803655:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224280.803658:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224280.803664:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165184 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5172f expref: 11 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.803699:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b16517d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51728 expref: 11 pid: 6715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.803714:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b16517d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51728 expref: 11 pid: 6715 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224280.803729:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6582:1868797333016448:192.168.202.7@tcp:104: 00000100:00100000:0.0:1782224280.803850:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfd540 going to sleep for 11 seconds 00000100:00100000:0.0:1782224280.818299:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6582:1868797333016448:192.168.202.7@tcp:104: 00010000:00010000:0.0:1782224280.818341:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165184 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5172f expref: 11 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224280.818365:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a75000, rc 0) 00000100:00100000:0.0:1782224280.818482:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+11:10523:x1868797312032256:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 14947us (15172us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224280.818493:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:2.0:1782224280.820629:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224280.822636:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312032384 00000100:00100000:0.0:1782224280.822650:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312032384 00010000:00010000:1.0:1782224280.822801:0:8291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b16517d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51728 expref: 11 pid: 6715 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224280.822887:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:1.0:1782224280.822899:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea860b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+11:2347:x1868797312032384:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782224280.822929:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224280.822959:0:8291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b16517d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51728 expref: 11 pid: 6715 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.822996:0:8291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b16517d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51728 expref: 11 pid: 6715 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.823041:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b16517d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51728 expref: 11 pid: 6715 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.823061:0:8291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224280.823065:0:8291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224280.823073:0:8291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165184 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5172f expref: 10 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.823084:0:8291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165184 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5172f expref: 10 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.823191:0:8291:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165184 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5172f expref: 10 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224280.823208:0:8291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabccb9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8291:1868797333016576:192.168.202.7@tcp:105: 00000100:00100000:1.0:1782224280.823392:0:8291:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905f2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782224280.829561:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224280.829863:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312032512 00000100:00100000:0.0:1782224280.829880:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312032512 00002000:00100000:0.0:1782224280.829966:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff96eabba6ca80 x1868797312032512/t0(0) o4->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:736/0 lens 504/0 e 0 to 0 dl 1782224291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782224280.829980:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96eabba6ca80 with x1868797312032512 ext(0->12) 00002000:00010000:0.0:1782224280.829987:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96eabba6ca80 00000100:00100000:0.0:1782224280.830046:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:0.0:1782224280.830057:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+11:2346:x1868797312032512:12345-192.168.202.7@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1782224280.830842:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:2346:x1868797312032512:12345-192.168.202.7@tcp:4:lhsmtool_posix.0 Request processed in 782us (1288us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1782224280.830854:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 2 00002000:00100000:0.0:1782224280.830863:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff96eabba6ca80 x1868797312032512/t4294967308(0) o4->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:736/0 lens 504/448 e 0 to 0 dl 1782224291 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782224280.830872:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96eabba6ca80 with x1868797312032512 ext(0->12) 00002000:00010000:0.0:1782224280.830877:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96eabba6ca80 00000100:00100000:1.0:1782224280.831523:0:8291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabccb9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8291:1868797333016576:192.168.202.7@tcp:105: 00010000:00010000:1.0:1782224280.831560:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224280.831606:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea860b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+12:2347:x1868797312032384:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 8710us (10987us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224280.831615:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:3.0:1782224280.835325:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224280.838202:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312032640 00000100:00100000:2.0:1782224280.838996:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312032640 00000100:00100000:2.0:1782224280.839359:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 124 00000100:00100000:2.0:1782224280.839372:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+61:10523:x1868797312032640:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1782224280.976840:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000001:00080000:3.0:1782224280.976920:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:3.0:1782224280.976928:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1782224280.976964:0:5808:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96ea828fe780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1782224280.976970:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff96ea86851900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96ea828fee40 00000020:00080000:3.0:1782224280.976975:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff96ea86851100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96ea85291800 00000004:00080000:3.0:1782224280.976997:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1782224280.977600:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1782224280.977628:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333016832:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1782224280.977744:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224280.977854:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782224280.977861:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333016704:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782224280.977887:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224280.977936:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333016832 00000100:00100000:3.0:1782224280.977946:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333016832 00000100:00100000:3.0:1782224280.978057:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333016704 00000100:00100000:3.0:1782224280.978062:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333016704 00000100:00100000:3.0:1782224280.978091:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782224280.978423:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1868797333016832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1782224280.978759:0:6715:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1782224280.978763:0:6715:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782224280 00002000:00010000:3.0:1782224280.978766:0:6715:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1782224280.978768:0:6715:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1782224280 -> 1782224280 00002000:00010000:3.0:1782224280.978792:0:6715:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782224280.979132:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3306:x1868797333016832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1029us (1385us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1782224280.979145:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782224280.979179:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782224280.979190:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1868797333016704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782224280.979212:0:6715:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1782224280.979415:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16518b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.979446:0:6715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8d721b8/0xcfd8b3ae4b164f4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5168e expref: 11 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.979455:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1782224280.979460:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782224280.979466:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16518b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.979508:0:6715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8d721b8/0xcfd8b3ae4b164f4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5168e expref: 11 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.979526:0:6715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8d721b8/0xcfd8b3ae4b164f4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5168e expref: 11 pid: 6582 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224280.979543:0:6715:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf7fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6715:1868797333016960:192.168.202.7@tcp:104: 00000100:00100000:3.0:1782224280.979932:0:6715:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8bada540 going to sleep for 11 seconds 00000100:00080000:3.0:1782224280.979978:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1782224280.980078:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:3.0:1782224280.980122:0:5808:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96ea832ed6c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1782224280.980127:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff96ea90e8f800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96ea832ed240 00000020:00080000:3.0:1782224280.980132:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff96ea90e8f600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96eabc01a400 00000020:00080000:3.0:1782224280.980165:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 0 00000020:00080000:3.0:1782224280.984207:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00080000:3.0:1782224280.984564:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1782224280.985645:0:5808:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:1.0:1782224280.985962:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabccb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333017088:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782224280.986094:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224280.986388:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333017088 00000100:00100000:3.0:1782224280.986399:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333017088 00000100:00100000:3.0:1782224280.986472:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782224280.986486:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1868797333017088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782224280.986528:0:6585:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1782224280.986577:0:6585:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a3a9596, atime: 0x6a3a9597, ctime: 0x6a3a9596, blocks: 0x1 00010000:00010000:3.0:1782224280.986597:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f643605/0xcfd8b3ae4b165192 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.986622:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1782224280.986627:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782224280.986638:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f643605/0xcfd8b3ae4b165192 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.987081:0:6585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f643605/0xcfd8b3ae4b165192 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.987098:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f643605/0xcfd8b3ae4b165192 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782224280.987934:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96eabfcb8a80/2, rc 0, transno 4294967309 00000100:00100000:0.0:1782224280.987951:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333016832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1782224280.988239:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+15:10523:x1868797312032640:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 Request processed in 148852us (152910us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224280.988253:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 124 00010000:00010000:3.0:1782224280.988693:0:6585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f643605/0xcfd8b3ae4b165192 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224280.988719:0:6585:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782224280.991557:0:6715:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf7fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6715:1868797333016960:192.168.202.7@tcp:104: 00010000:00010000:1.0:1782224280.991615:0:6715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16518b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224280.992129:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224280.992524:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312032768 00000100:00100000:2.0:1782224280.992537:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312032768 00010000:00010000:2.0:1782224280.992602:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8d721b8/0xcfd8b3ae4b164f4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5168e expref: 12 pid: 6582 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224280.992663:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 54 00000100:00100000:2.0:1782224280.992677:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+12:2346:x1868797312032768:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782224280.992700:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224280.992708:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8d721b8/0xcfd8b3ae4b164f4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5168e expref: 12 pid: 6582 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224280.992724:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8d721b8/0xcfd8b3ae4b164f4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5168e expref: 12 pid: 6582 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224280.992764:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8d721b8/0xcfd8b3ae4b164f4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5168e expref: 12 pid: 6582 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224280.992800:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782224280.992806:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782224280.992814:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16518b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224280.992827:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16518b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224280.992897:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224280.992979:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+11:2346:x1868797312032768:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 304us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224280.992989:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 54 00010000:00010000:1.0:1782224280.993806:0:6715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16518b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.993826:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16518b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.993839:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16518b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.993849:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16518b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.993874:0:6715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782224280.993896:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782224280.993906:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f643605/0xcfd8b3ae4b165192 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.993917:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675a00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224280.993922:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f643605/0xcfd8b3ae4b165192 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.993956:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f643605/0xcfd8b3ae4b165192 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.993974:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f643605/0xcfd8b3ae4b165192 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.993982:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f643605/0xcfd8b3ae4b165192 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.994050:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224280.994054:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16518b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.994062:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674600 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224280.994065:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16518b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.994073:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16518b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.994085:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16518b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.994092:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16518b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224280.994134:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224280.994136:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224280.994138:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224281.001128:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224281.006956:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1868797333017088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20450us (20840us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1782224281.006979:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1782224281.007142:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96eabccb9880/2, rc 0, transno 4294967304 00000100:00100000:2.0:1782224281.007149:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabccb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333017088:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782224281.011072:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3306:x1868797333016704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31870us (33168us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1782224281.011094:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1782224281.011443:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96ea86104a80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1782224281.011454:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333016704:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782224281.011985:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224281.012841:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312032896 00000100:00100000:0.0:1782224281.012859:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312032896 00000100:00100000:0.0:1782224281.012980:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00100000:0.0:1782224281.012995:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+11:2349:x1868797312032896:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1782224281.122887:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1782224281.122935:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:3.0:1782224281.123175:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2349:x1868797312032896:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 Request processed in 110175us (111186us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224281.123189:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00100000:2.0:1782224281.128931:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224281.129070:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312033152 00000100:00100000:1.0:1782224281.129083:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312033152 00000100:00100000:1.0:1782224281.129436:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 125 00000100:00100000:1.0:1782224281.129448:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+15:10523:x1868797312033152:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782224281.129518:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224281.129550:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165176 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51721 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.129575:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96eaa7d65100) 00010000:00010000:1.0:1782224281.129580:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782224281.129628:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165199 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.129645:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.129886:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782224281.130483:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001abe44c0 reply state 00000000c35f848c transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224281.130515:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782224281.130804:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+16:10523:x1868797312033152:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 1354us (1894us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1782224281.130813:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 125 00000100:00100000:3.0:1782224281.138773:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:2.0:1782224281.138903:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.138928:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165199 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.138937:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165199 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.138944:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224281.138950:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165199 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.138958:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165199 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.138980:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96eaa7d65100) 00010000:00010000:2.0:1782224281.139001:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224281.139008:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165199 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.139045:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165199 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224281.139297:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312033280 00000100:00100000:1.0:1782224281.139312:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312033280 00000100:00100000:1.0:1782224281.139378:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 44 00000100:00100000:1.0:1782224281.139391:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797312033280:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1782224281.139754:0:6715:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1782224281.139758:0:6715:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1782224280 -> 1782224279 00002000:00010000:1.0:1782224281.139761:0:6715:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1782224279 00002000:00010000:1.0:1782224281.139764:0:6715:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1782224280 -> 1782224279 00002000:00010000:1.0:1782224281.139766:0:6715:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1782224281.140850:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2347:x1868797312033280:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 1452us (2085us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1782224281.140862:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 44 00000100:00100000:3.0:1782224281.144730:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224281.144878:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312033536 00000100:00100000:0.0:1782224281.144895:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312033536 00000100:00100000:0.0:1782224281.145100:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 126 00000100:00100000:0.0:1782224281.145187:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+15:10523:x1868797312033536:12345-192.168.202.7@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1782224281.145376:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1651a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224281.145399:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b16515a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51713 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224281.145410:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1651a0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224281.145458:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b16515a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51713 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224281.145474:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b16515a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51713 expref: 15 pid: 5787 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224281.145494:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d23480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333017216:192.168.202.7@tcp:104: 00000100:00100000:0.0:1782224281.145630:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea863576c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782224281.150977:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224281.151089:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312033664 00000100:00100000:2.0:1782224281.151108:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312033664 00010000:00010000:2.0:1782224281.151164:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b16515a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51713 expref: 16 pid: 5787 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224281.151213:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 55 00000100:00100000:2.0:1782224281.151226:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+16:2346:x1868797312033664:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782224281.151248:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224281.151258:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b16515a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51713 expref: 16 pid: 5787 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224281.152755:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d23480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333017216:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224281.152861:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b16515a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51713 expref: 16 pid: 5787 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.152900:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1651a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.157497:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b16515a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51713 expref: 16 pid: 5787 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.157533:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96eaa7d65100) 00010000:00010000:2.0:1782224281.157540:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1651a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.157552:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1651a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.157596:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1651a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.157778:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224281.157870:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+15:2346:x1868797312033664:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 6644us (6913us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224281.157881:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 55 00010000:00010000:1.0:1782224281.160423:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1651a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.160445:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1651a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.160516:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1651a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.160525:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1651a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.160535:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1651a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.160542:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224281.160548:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1651a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.160558:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1651a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.160580:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96eaa7d65100) 00010000:00010000:1.0:1782224281.160585:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1782224281.160601:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1651a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.160607:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1651a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224281.161311:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+14:10523:x1868797312033536:12345-192.168.202.7@tcp:55:lhsmtool_posix.0 Request processed in 16119us (16669us total) trans 0 rc -22/-22 00000100:00100000:1.0:1782224281.161326:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 126 00000100:00100000:3.0:1782224281.165552:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224281.165787:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312033792 00000100:00100000:2.0:1782224281.165801:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312033792 00000100:00100000:2.0:1782224281.165921:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:2.0:1782224281.165934:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312033792:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1782224281.165997:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b1651a7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.166067:0:6585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165184 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5172f expref: 7 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.166077:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782224281.166082:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782224281.166087:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b1651a7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.166144:0:6585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165184 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5172f expref: 7 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.166160:0:6585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165184 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5172f expref: 7 pid: 6582 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224281.166202:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83514e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6585:1868797333017344:192.168.202.7@tcp:104: 00000100:00100000:2.0:1782224281.166912:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8820f900 going to sleep for 11 seconds 00000100:00100000:0.0:1782224281.173124:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224281.173213:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312033920 00000100:00100000:3.0:1782224281.173226:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312033920 00010000:00010000:3.0:1782224281.173294:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165184 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5172f expref: 8 pid: 6582 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224281.173349:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 56 00000100:00100000:3.0:1782224281.173360:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2347:x1868797312033920:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224281.173383:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224281.173413:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165184 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5172f expref: 8 pid: 6582 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.173456:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165184 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5172f expref: 8 pid: 6582 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.173494:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782224281.173500:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782224281.173508:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b1651a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.173519:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b1651a7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.173546:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224281.173634:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2347:x1868797312033920:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 275us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224281.173644:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 56 00010000:00010000:2.0:1782224281.176922:0:6585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165184 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5172f expref: 7 pid: 6582 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224281.176962:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83514e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6585:1868797333017344:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224281.177009:0:6585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b1651a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.177053:0:6585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b1651a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.177062:0:6585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b1651a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.177128:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b1651a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.177139:0:6585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b1651a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.177150:0:6585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b1651a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.177188:0:6585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:2.0:1782224281.177195:0:6585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b1651a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.177206:0:6585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b1651a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.177236:0:6585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b1651a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.177245:0:6585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a54d5a5/0xcfd8b3ae4b1651a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224281.177452:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2346:x1868797312033792:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 Request processed in 11520us (12435us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224281.177465:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:0.0:1782224281.184610:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224281.184774:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312034176 00000100:00100000:1.0:1782224281.184790:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312034176 00000100:00100000:1.0:1782224281.184875:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 127 00000100:00100000:1.0:1782224281.184908:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+14:10523:x1868797312034176:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1782224281.185070:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1651ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.185093:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1651ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.185403:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1651ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.187424:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1651b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.187455:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165168 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5171a expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.187466:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1651b5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.187515:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165168 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5171a expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.187532:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165168 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5171a expref: 15 pid: 5787 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224281.187549:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabccbaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1868797333017472:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224281.187967:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782224281.193101:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224281.193311:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabccbaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1868797333017472:192.168.202.7@tcp:104: 00010000:00010000:0.0:1782224281.193354:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1651b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224281.194523:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312034304 00000100:00100000:2.0:1782224281.194536:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312034304 00010000:00010000:2.0:1782224281.194598:0:8291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165168 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5171a expref: 16 pid: 5787 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224281.194659:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 57 00000100:00100000:2.0:1782224281.194672:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+16:2346:x1868797312034304:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782224281.194694:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224281.194701:0:8291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165168 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5171a expref: 16 pid: 5787 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.194732:0:8291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165168 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5171a expref: 16 pid: 5787 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.194761:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165168 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5171a expref: 16 pid: 5787 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.194784:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96eaa7d65100) 00010000:00010000:2.0:1782224281.194790:0:8291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1651b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.194801:0:8291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1651b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.194810:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1651b5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.194848:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224281.194943:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+15:2346:x1868797312034304:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 271us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224281.194952:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 57 00010000:00010000:1.0:1782224281.195923:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1651b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.195948:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1651b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782224281.196290:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1782224281.196479:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1782224281.196527:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1782224281.196664:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabccb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5787:1868797333017600:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1782224281.196764:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224281.196805:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfda80 going to sleep for 11 seconds 00000100:00100000:2.0:1782224281.197854:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333017600 00000100:00100000:2.0:1782224281.197869:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333017600 00000100:00100000:2.0:1782224281.197958:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782224281.197971:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5787:x1868797333017600:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782224281.198160:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5787:x1868797333017600:12345-0@lo:1000:mdt00_001.0 Request processed in 191us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224281.198169:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782224281.198571:0:5787:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1782224281.198581:0:5787:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1782224281.198613:0:5787:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96eabfcb8a80, transno 4294967309 00000004:00080000:1.0:1782224281.198628:0:5787:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96ea86104a80, transno 4294967310 00000100:00100000:1.0:1782224281.198636:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabccb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5787:1868797333017600:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1782224281.199882:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1782224281.200523:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabccb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5787:1868797333017728:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1782224281.200617:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224281.200721:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfd240 going to sleep for 11 seconds 00000100:00100000:2.0:1782224281.200854:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333017728 00000100:00100000:2.0:1782224281.200864:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333017728 00000100:00100000:2.0:1782224281.200936:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782224281.200948:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5787:x1868797333017728:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782224281.201226:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5787:x1868797333017728:12345-0@lo:1000:mdt00_001.0 Request processed in 279us (608us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1782224281.201235:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782224281.201566:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabccb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5787:1868797333017728:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1782224281.201635:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1651b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.201659:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1651b5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.201670:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1651b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.201699:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224281.201705:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1651b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.201715:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1651b5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.201739:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96eaa7d65100) 00010000:00010000:1.0:1782224281.201743:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782224281.201749:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1651b5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.201756:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1651b5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.201803:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.201810:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650f8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.201816:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.201820:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224281.201824:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.201829:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650f8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.201852:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:1.0:1782224281.201854:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782224281.201863:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55600/0xcfd8b3ae4b1650ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516fe expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.201878:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55600/0xcfd8b3ae4b1650ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516fe expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.201888:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55600/0xcfd8b3ae4b1650ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516fe expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.201936:0:5787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55600/0xcfd8b3ae4b1650ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516fe expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224281.201951:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabccb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1868797333017856:192.168.202.7@tcp:105: 00000100:00100000:1.0:1782224281.202071:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfd240 going to sleep for 11 seconds 00000100:00100000:2.0:1782224281.206801:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabccb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1868797333017856:192.168.202.7@tcp:105: 00010000:00010000:2.0:1782224281.206845:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650f8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.206858:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1650f8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.206906:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1651bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.206936:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1651bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.206950:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1651bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.206962:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1651bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.206969:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1651bc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.206976:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1651bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.207003:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224281.207008:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1651bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.207045:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1651bc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.207060:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:2.0:1782224281.207063:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224281.207066:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1651bc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.207071:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1651bc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.207082:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1651ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.207088:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1651ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.207093:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1651ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.207098:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224281.207176:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1651ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.207183:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1651ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.207204:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:2.0:1782224281.207207:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782224281.207210:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1651ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.207217:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1651ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224281.208313:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:10523:x1868797312034176:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 23396us (23712us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1782224281.208327:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 127 00000020:00080000:2.0:1782224281.208336:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1782224281.209875:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782224281.209887:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782224281.210613:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1782224281.210630:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782224281.212511:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224281.214044:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312034432 00000100:00100000:3.0:1782224281.214063:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312034432 00000100:00100000:3.0:1782224281.215265:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 31 00000100:00100000:3.0:1782224281.215287:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:10522:x1868797312034432:12345-192.168.202.7@tcp:49:lfs.0 00000100:00100000:3.0:1782224281.215510:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:10522:x1868797312034432:12345-192.168.202.7@tcp:49:lfs.0 Request processed in 229us (3010us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224281.215541:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 31 00000100:00100000:1.0:1782224281.215764:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224281.220072:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224281.220142:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312034944 00000100:00100000:1.0:1782224281.220157:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312034944 00000100:00100000:1.0:1782224281.220238:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 128 00000100:00100000:1.0:1782224281.220253:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:10522:x1868797312034944:12345-192.168.202.7@tcp:58:lfs.0 00000040:00080000:1.0:1782224281.220874:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1782224281.221006:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:10522:x1868797312034944:12345-192.168.202.7@tcp:58:lfs.0 Request processed in 755us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224281.221054:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 128 00000100:00100000:0.0:1782224281.225340:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312034688 00000100:00100000:0.0:1782224281.225363:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312034688 00000100:00100000:0.0:1782224281.225452:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 32 00000100:00100000:0.0:1782224281.225466:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea9c44d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:10523:x1868797312034688:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1782224281.226466:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1782224281.226610:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1782224281.226678:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b1651c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224281.226701:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b1651c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224281.226715:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b1651c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224281.226726:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b1651c3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224281.226734:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b1651c3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224281.226741:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b1651c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224281.226768:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782224281.226921:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea9c44d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+20:10523:x1868797312034688:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 1454us (11154us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1782224281.226932:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 32 00000020:00080000:0.0:1782224281.226949:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782224281.227734:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224281.227746:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b1651c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.227757:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74200 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224281.227762:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b1651c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.227773:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b1651c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.227791:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96eaa7d65400) 00010000:00010000:1.0:1782224281.227794:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782224281.227799:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b1651c3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.227805:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b1651c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224281.227832:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224281.227834:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224281.227836:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224281.286156:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224281.286469:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312035072 00000100:00100000:3.0:1782224281.286482:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312035072 00000100:00100000:3.0:1782224281.286553:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 129 00000100:00100000:3.0:1782224281.286564:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+20:10525:x1868797312035072:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1782224281.286623:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224281.286656:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b1651ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51736 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.286758:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1651d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.286777:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1651d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.286792:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1651d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.286810:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1651d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.286817:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1651d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.286823:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1651d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.287848:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b1651df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.288645:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b1650ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516f7 expref: 21 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.288656:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b1651df lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.293487:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b1650ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516f7 expref: 21 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.293520:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b1650ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516f7 expref: 21 pid: 6605 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224281.293542:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83514e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1868797333017984:192.168.202.7@tcp:104: 00000100:00100000:2.0:1782224281.293691:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8820f900 going to sleep for 11 seconds 00010000:00010000:2.0:1782224281.302845:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224281.305325:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224281.305853:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83514e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1868797333017984:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224281.305895:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b1651df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224281.306480:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312035328 00000100:00100000:1.0:1782224281.306492:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312035328 00000100:00100000:1.0:1782224281.306581:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:1.0:1782224281.306602:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+22:5563:x1868797312035328:12345-192.168.202.7@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1782224281.306990:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+23:5563:x1868797312035328:12345-192.168.202.7@tcp:35:ldlm_bl.0 Request processed in 388us (1678us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1782224281.306999:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:0.0:1782224281.312544:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224281.314293:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312035456 00000100:00100000:3.0:1782224281.314313:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312035456 00010000:00010000:3.0:1782224281.314387:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b1650ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516f7 expref: 23 pid: 6605 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224281.314451:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 58 00000100:00100000:3.0:1782224281.314463:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+23:2347:x1868797312035456:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224281.314487:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224281.314496:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b1650ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516f7 expref: 23 pid: 6605 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.314513:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b1650ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516f7 expref: 23 pid: 6605 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.314548:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b1650ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516f7 expref: 23 pid: 6605 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.314572:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:3.0:1782224281.314579:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b1651df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.314623:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b1651df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.314633:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b1651df lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224281.314678:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224281.314781:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+22:2347:x1868797312035456:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 318us (2259us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224281.314794:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 58 00010000:00010000:2.0:1782224281.315230:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b1651df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315254:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b1651df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224281.315316:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1782224281.315321:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224281.315351:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b1651df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315367:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b1651df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315378:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1651d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315386:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1651d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315394:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1651d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315400:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224281.315405:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1651d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315413:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1651d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315426:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:2.0:1782224281.315429:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224281.315433:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1651d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315449:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1651d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315472:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1651d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315478:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1651d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315484:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1651d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315489:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224281.315493:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1651d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315499:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1651d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315508:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96ea87df7300) 00010000:00010000:2.0:1782224281.315511:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224281.315514:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1651d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315520:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1651d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315579:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b1651ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51736 expref: 22 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315604:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b1651df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51736 expref: 21 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224281.315618:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:2.0:1782224281.315621:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782224281.315624:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674200, rc 0) 00000100:00100000:2.0:1782224281.315676:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+21:10525:x1868797312035072:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 29113us (29533us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224281.315684:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 129 00000100:00100000:3.0:1782224281.684403:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333018112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782224281.684507:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224281.684730:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333018112 00000100:00100000:0.0:1782224281.684740:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333018112 00000100:00100000:0.0:1782224281.684819:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782224281.684830:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1868797333018112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782224281.684875:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782224281.684950:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1868797333018112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224281.684958:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782224281.685011:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333018112:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782224281.685172:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1782224282.261475:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782224282.261488:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782224282.261598:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1782224282.261608:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782224282.261792:0:11523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcb8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11523:1868797333018240:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782224282.261912:0:11523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832edc00 going to sleep for 11 seconds 00000100:00100000:1.0:1782224282.269090:0:11523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcb8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11523:1868797333018240:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782224282.276893:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224282.277125:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312035584 00000100:00100000:3.0:1782224282.277138:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312035584 00000100:00100000:3.0:1782224282.278553:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 130 00000100:00100000:3.0:1782224282.278569:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+21:10536:x1868797312035584:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782224282.278626:0:5786:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782224282.278875:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+21:10536:x1868797312035584:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 310us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224282.278884:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 130 00000100:00080000:1.0:1782224282.282521:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224282.286837:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224282.286946:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312035840 00000100:00100000:2.0:1782224282.286961:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312035840 00000100:00100000:2.0:1782224282.287066:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 131 00000100:00100000:2.0:1782224282.287081:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+21:10536:x1868797312035840:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782224282.287122:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224282.287152:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b1651e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5173d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224282.287314:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1651ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224282.287335:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1651ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224282.287354:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1651ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224282.287368:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1782224282.287971:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b1651e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5173d expref: 24 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224282.288004:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1651ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5173d expref: 23 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224282.288011:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:2.0:1782224282.288042:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782224282.288046:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab200, rc 0) 00000100:00100000:3.0:1782224282.288168:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+23:10536:x1868797312035840:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 1089us (1345us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1782224282.288178:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 131 00000100:00100000:1.0:1782224282.302388:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224282.302457:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312036096 00000100:00100000:2.0:1782224282.302471:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312036096 00000100:00100000:1.0:1782224282.302493:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224282.302524:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312036224 00000100:00100000:1.0:1782224282.302528:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312036224 00000100:00100000:2.0:1782224282.302544:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 132 00000100:00100000:2.0:1782224282.302555:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+24:10536:x1868797312036096:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782224282.302571:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:1.0:1782224282.302591:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+24:2346:x1868797312036224:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782224282.302605:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224282.302637:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1651ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5173d expref: 24 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224282.302660:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:1.0:1782224282.302667:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224282.302669:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1651fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224282.302686:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1651fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224282.302696:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1651fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224282.302752:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+23:2346:x1868797312036224:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 173us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224282.302759:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00010000:00010000:2.0:1782224282.302948:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1651fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224282.302957:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1651fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224282.302964:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1651fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224282.302971:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab000 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224282.302985:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1651fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224282.302995:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1651fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224282.303005:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:2.0:1782224282.303008:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782224282.303012:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1651fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224282.303045:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1651fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224282.303178:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+23:10536:x1868797312036096:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 624us (800us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1782224282.303186:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 132 00000040:00080000:1.0:1782224282.304167:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782224282.304174:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782224282.304654:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1782224282.304670:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782224282.311246:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224282.311437:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312036480 00000100:00100000:2.0:1782224282.311451:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312036480 00000100:00100000:2.0:1782224282.311555:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 34 00000100:00100000:2.0:1782224282.311566:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+23:10536:x1868797312036480:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782224282.311936:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+24:10536:x1868797312036480:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 370us (703us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1782224282.311946:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 34 00010000:00010000:1.0:1782224282.324218:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224282.717923:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797333018496:0@lo:400:kworker.0 00000100:00100000:2.0:1782224282.718012:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224282.718084:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf5a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333019008:0@lo:400:kworker.0 00000100:00100000:2.0:1782224282.718111:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224282.718151:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782224282.718156:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797333018368:0@lo:400:kworker.0 00000100:00100000:2.0:1782224282.718184:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224282.718202:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf5a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333018880:0@lo:400:kworker.0 00000100:00100000:2.0:1782224282.718223:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224282.718248:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf5a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333018624:0@lo:400:kworker.0 00000100:00100000:0.0:1782224282.718392:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf5a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333018752:0@lo:400:kworker.0 00000100:00100000:0.0:1782224282.718423:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224282.718478:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333019008 00000100:00100000:0.0:1782224282.718486:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333019008 00000100:00100000:0.0:1782224282.718538:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333018752 00000100:00100000:0.0:1782224282.718541:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333018752 00000100:00100000:0.0:1782224282.718561:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782224282.718569:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1868797333019008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224282.718717:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224282.718748:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333018496 00000100:00100000:2.0:1782224282.718752:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333018496 00000100:00100000:2.0:1782224282.718779:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333018880 00000100:00100000:2.0:1782224282.718781:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333018880 00000100:00100000:2.0:1782224282.718793:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333018624 00000100:00100000:2.0:1782224282.718795:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333018624 00000100:00100000:2.0:1782224282.718807:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1782224282.718812:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797333018496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224282.718841:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797333018496:12345-0@lo:400:kworker.0 Request processed in 27us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224282.718849:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1782224282.718866:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1782224282.718871:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797333018880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224282.718890:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797333018880:12345-0@lo:400:kworker.0 Request processed in 19us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224282.718895:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1782224282.718904:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782224282.718909:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333018624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224282.718930:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333018624:12345-0@lo:400:kworker.0 Request processed in 21us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224282.718946:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782224282.718965:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782224282.718971:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc89bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1868797333018752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224282.719001:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc89bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1868797333018752:12345-0@lo:400:kworker.0 Request processed in 31us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224282.719007:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782224282.719048:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333018368 00000100:00100000:2.0:1782224282.719052:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333018368 00000100:00100000:2.0:1782224282.719076:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1782224282.719082:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797333018368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224282.719108:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797333018368:12345-0@lo:400:kworker.0 Request processed in 26us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224282.719113:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1782224282.719159:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf5a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333018624:0@lo:400:kworker.0 00000100:00100000:0.0:1782224282.722776:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1868797333019008:12345-0@lo:400:kworker.0 Request processed in 4191us (4647us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224282.722795:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782224282.722906:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797333018368:0@lo:400:kworker.0 00000100:00100000:0.0:1782224282.722929:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf5a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333018880:0@lo:400:kworker.0 00000100:00100000:0.0:1782224282.722960:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797333018496:0@lo:400:kworker.0 00000100:00100000:0.0:1782224282.722977:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf5a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333019008:0@lo:400:kworker.0 00000100:00100000:0.0:1782224282.723055:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf5a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333018752:0@lo:400:kworker.0 00000100:00080000:3.0:1782224282.727529:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782224282.727543:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1782224282.732550:0:11945:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782224282.732563:0:11945:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782224282.732625:0:11945:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1782224282.732631:0:11945:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782224282.920424:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224282.928697:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312036736 00000100:00100000:2.0:1782224282.928712:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312036736 00000100:00100000:2.0:1782224282.928798:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 133 00000100:00100000:2.0:1782224282.928809:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+24:10549:x1868797312036736:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1782224282.928840:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224282.928865:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b165202 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51744 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224282.928990:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b165209 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224282.929008:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b165209 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224282.929061:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b165209 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224282.929075:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1782224282.929227:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa400/0xcfd8b3ae4b165202 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51744 expref: 27 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224282.929245:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b165209 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51744 expref: 26 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224282.929255:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:2.0:1782224282.929259:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1782224282.929263:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaaa00, rc 0) 00000100:00100000:2.0:1782224282.929342:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+26:10549:x1868797312036736:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 535us (8932us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1782224282.929349:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 133 00000100:00100000:3.0:1782224282.943288:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224282.944796:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312036864 00000100:00100000:3.0:1782224282.944813:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312036864 00000100:00100000:3.0:1782224282.944884:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 134 00000100:00100000:3.0:1782224282.944896:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+26:10549:x1868797312036864:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:3.0:1782224282.944991:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165217 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224282.945031:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224282.945047:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224282.945097:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224282.945104:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165217 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224282.945111:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165217 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224282.945116:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224282.945121:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165217 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224282.945140:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165217 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224282.945157:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:3.0:1782224282.945161:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782224282.945166:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165217 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224282.945171:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165217 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224282.945268:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+26:10549:x1868797312036864:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 374us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224282.945277:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 134 00000100:00100000:0.0:1782224283.078990:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224283.079226:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312036992 00000100:00100000:2.0:1782224283.079239:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312036992 00000100:00100000:2.0:1782224283.079344:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00100000:2.0:1782224283.079358:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797312036992:12345-192.168.202.7@tcp:101:cat.0 00010000:00010000:2.0:1782224283.079391:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224283.079419:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000551c5146/0xcfd8b3ae4b16521e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5174b expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782224283.079458:0:6715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a3a9597, atime: 0x6a3a9597, ctime: 0x6a3a9597, blocks: 0xb 00010000:00010000:2.0:1782224283.079483:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1782224283.079504:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782224283.079515:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000551c5146/0xcfd8b3ae4b16521e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5174b expref: 7 pid: 6715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224283.079541:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000551c5146/0xcfd8b3ae4b16521e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5174b expref: 7 pid: 6715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224283.079557:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaa400, rc 0) 00000100:00100000:2.0:1782224283.079643:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2347:x1868797312036992:12345-192.168.202.7@tcp:101:cat.0 Request processed in 288us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224283.079651:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00080000:3.0:1782224283.080555:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782224283.082718:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224283.083307:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312037120 00000100:00100000:1.0:1782224283.083324:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312037120 00002000:00100000:1.0:1782224283.083517:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff96ea83360380 x1868797312037120/t0(0) o3->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:739/0 lens 488/0 e 0 to 0 dl 1782224294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782224283.083550:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96ea83360380 with x1868797312037120 ext(0->4095) 00002000:00010000:1.0:1782224283.083558:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96ea83360380 00000100:00100000:1.0:1782224283.083610:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:1.0:1782224283.083620:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2347:x1868797312037120:12345-192.168.202.7@tcp:3:cat.0 00000100:00100000:1.0:1782224283.083978:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2347:x1868797312037120:12345-192.168.202.7@tcp:3:cat.0 Request processed in 358us (1270us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1782224283.083987:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 3 00002000:00100000:1.0:1782224283.083995:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff96ea83360380 x1868797312037120/t0(0) o3->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:739/0 lens 488/4536 e 0 to 0 dl 1782224294 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782224283.084003:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96ea83360380 with x1868797312037120 ext(0->4095) 00002000:00010000:1.0:1782224283.084007:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96ea83360380 00000100:00100000:1.0:1782224283.155544:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224283.155668:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224283.155721:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224283.155773:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312037504 00000100:00100000:3.0:1782224283.155788:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312037504 00000100:00100000:3.0:1782224283.155880:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 142 00000100:00100000:3.0:1782224283.155900:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2346:x1868797312037504:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224283.155983:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2346:x1868797312037504:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 94us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224283.155990:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 142 00000100:00100000:0.0:1782224283.156498:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312037376 00000100:00100000:0.0:1782224283.156508:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312037376 00000100:00100000:0.0:1782224283.156587:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 80 00000100:00100000:0.0:1782224283.156597:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312037376:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224283.156671:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312037376:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 76us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224283.156680:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 80 00000100:00080000:1.0:1782224283.157556:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782224283.157564:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224283.161864:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312037248 00000100:00100000:2.0:1782224283.161884:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312037248 00000100:00100000:2.0:1782224283.161978:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 289 00000100:00100000:2.0:1782224283.161992:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2346:x1868797312037248:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224283.162768:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2346:x1868797312037248:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 774us (7234us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224283.162778:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 289 00000100:00100000:1.0:1782224283.222375:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782224283.222400:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333019136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782224283.222476:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224283.222875:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333019136 00000100:00100000:0.0:1782224283.222883:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333019136 00000100:00100000:0.0:1782224283.222944:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782224283.222953:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1868797333019136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782224283.222992:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782224283.223317:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1868797333019136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 364us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224283.223324:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782224283.223650:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333019136:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782224283.348421:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782224284.352807:0:6608:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1782224284.352832:0:6608:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1782224284.352864:0:6608:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:1.0:1782224284.372822:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224285.396537:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782224286.399515:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000001:00080000:1.0:1782224286.399565:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000020:00080000:1.0:1782224286.399578:0:5808:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96ea88bfda80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1782224286.399583:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff96ea86851c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96ea88bfde40 00000020:00080000:1.0:1782224286.399603:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff96ea86851300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96ea85cecc00 00000001:00080000:1.0:1782224286.399638:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1782224286.399664:0:5808:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1782224286.401795:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1782224286.402087:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1782224286.414279:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1782224286.414307:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:1.0:1782224286.420221:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224286.807450:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224286.823289:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333019264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782224286.823384:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224286.823488:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333019264 00000100:00100000:1.0:1782224286.823496:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333019264 00000100:00100000:1.0:1782224286.823571:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782224286.823582:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333019264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782224286.823620:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224286.823671:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333019264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224286.823678:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782224286.823717:0:3303:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1782224286.823724:0:3303:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1782224286.823752:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96eabccb9880, transno 4294967304 00000100:00100000:1.0:1782224286.823774:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333019264:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782224286.824310:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782224287.445955:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224287.831303:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabbbddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333019776:0@lo:400:kworker.0 00000100:00100000:1.0:1782224287.831416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224287.831497:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782224287.831504:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabbbdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797333019648:0@lo:400:kworker.0 00000100:00100000:1.0:1782224287.831547:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224287.831708:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabccb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797333019392:0@lo:400:kworker.0 00000100:00100000:0.0:1782224287.831753:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224287.831808:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabbbdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797333019904:0@lo:400:kworker.0 00000100:00100000:0.0:1782224287.831834:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224287.831855:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782224287.831860:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabccbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333019520:0@lo:400:kworker.0 00000100:00100000:0.0:1782224287.831882:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224287.831899:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333020032:0@lo:400:kworker.0 00000100:00100000:0.0:1782224287.831922:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224287.831958:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333019776 00000100:00100000:0.0:1782224287.831968:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333019776 00000100:00100000:0.0:1782224287.832053:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333020032 00000100:00100000:0.0:1782224287.832057:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333020032 00000100:00100000:0.0:1782224287.832101:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782224287.832110:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333019776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224287.832180:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333019776:12345-0@lo:400:kworker.0 Request processed in 71us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224287.832188:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782224287.832205:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782224287.832212:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333020032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224287.832245:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333020032:12345-0@lo:400:kworker.0 Request processed in 34us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224287.832252:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782224287.832317:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1782224287.832324:0:3305:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1782224287.832349:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333020032:0@lo:400:kworker.0 00000100:00100000:0.0:1782224287.832376:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabbbddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333019776:0@lo:400:kworker.0 00000100:00080000:2.0:1782224287.832564:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782224287.832672:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333019392 00000100:00100000:1.0:1782224287.832678:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333019392 00000100:00100000:1.0:1782224287.832756:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1782224287.832763:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797333019392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224287.832826:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797333019392:12345-0@lo:400:kworker.0 Request processed in 63us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224287.832833:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1782224287.832931:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333019648 00000100:00100000:3.0:1782224287.832944:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333019648 00000100:00100000:3.0:1782224287.832983:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333019904 00000100:00100000:3.0:1782224287.832986:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333019904 00000100:00100000:3.0:1782224287.832999:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333019520 00000100:00100000:3.0:1782224287.833001:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333019520 00000100:00100000:3.0:1782224287.833039:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782224287.833047:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797333019648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224287.833107:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797333019648:12345-0@lo:400:kworker.0 Request processed in 61us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224287.833114:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782224287.833128:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1782224287.833133:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797333019904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224287.833160:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797333019904:12345-0@lo:400:kworker.0 Request processed in 26us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224287.833166:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1782224287.833177:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782224287.833182:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333019520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224287.833210:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333019520:12345-0@lo:400:kworker.0 Request processed in 28us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224287.833216:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1782224287.833246:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224287.833271:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabbbdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797333019648:0@lo:400:kworker.0 00000100:00100000:0.0:1782224287.834366:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabccbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333019520:0@lo:400:kworker.0 00000100:00100000:0.0:1782224287.834393:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabccb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797333019392:0@lo:400:kworker.0 00000100:00100000:0.0:1782224287.834406:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabbbdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797333019904:0@lo:400:kworker.0 00000100:00100000:3.0:1782224288.272108:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224288.272157:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224288.272216:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224288.272249:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224288.272279:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224288.272330:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312038144 00000100:00100000:3.0:1782224288.272345:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312038144 00000100:00100000:3.0:1782224288.272435:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312037760 00000100:00100000:3.0:1782224288.272439:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312037760 00000100:00100000:3.0:1782224288.273269:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 146 00000100:00100000:3.0:1782224288.273289:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2349:x1868797312038144:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224288.273527:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312037632 00000100:00100000:0.0:1782224288.273535:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312037632 00000100:00100000:0.0:1782224288.273586:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 291 00000100:00100000:0.0:1782224288.273594:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8322e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2349:x1868797312037632:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224288.274311:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312037888 00000100:00100000:1.0:1782224288.274321:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312037888 00000100:00100000:1.0:1782224288.274369:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312038016 00000100:00100000:1.0:1782224288.274373:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312038016 00000100:00100000:1.0:1782224288.274407:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 83 00000100:00100000:1.0:1782224288.274416:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2349:x1868797312037888:12345-192.168.202.7@tcp:400:kworker.0 00000100:00080000:2.0:1782224288.275332:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782224288.275341:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782224288.275344:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224288.275375:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 147 00000100:00100000:2.0:1782224288.275418:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:2349:x1868797312037760:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224288.275573:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2349:x1868797312038144:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 2289us (3353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224288.275583:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 146 00000100:00100000:0.0:1782224288.275915:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8322e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2349:x1868797312037632:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 2319us (3820us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224288.275926:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 291 00000100:00100000:1.0:1782224288.276234:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2349:x1868797312037888:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 1816us (4074us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224288.276245:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 83 00000100:00100000:1.0:1782224288.276268:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 84 00000100:00100000:1.0:1782224288.276278:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2349:x1868797312038016:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224288.276319:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2349:x1868797312038016:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 44us (4039us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224288.276325:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 84 00000100:00100000:2.0:1782224288.280109:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:2349:x1868797312037760:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 4683us (7842us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224288.280131:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 147 00000100:00100000:3.0:1782224288.347632:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabbbdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333020160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782224288.347924:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224288.348632:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333020160 00000100:00100000:2.0:1782224288.348645:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333020160 00000100:00100000:2.0:1782224288.349831:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782224288.349852:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333020160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782224288.349908:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224288.349999:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333020160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224288.350007:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782224288.350090:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabbbdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333020160:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782224288.468341:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224289.246352:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224289.246626:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312038272 00000100:00100000:0.0:1782224289.246642:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312038272 00000100:00100000:0.0:1782224289.246730:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 135 00000100:00100000:0.0:1782224289.246743:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:10201:x1868797312038272:12345-192.168.202.7@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1782224289.246898:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:10201:x1868797312038272:12345-192.168.202.7@tcp:60:lhsmtool_posix.0 Request processed in 158us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224289.246907:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 135 00000100:00100000:1.0:1782224289.254988:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224289.255197:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312038528 00000100:00100000:0.0:1782224289.255211:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312038528 00000100:00100000:0.0:1782224289.255288:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 35 00000100:00100000:0.0:1782224289.255310:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:10201:x1868797312038528:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782224289.258719:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+14:10201:x1868797312038528:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 3388us (3723us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1782224289.258740:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 35 00010000:00010000:0.0:1782224289.492454:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782224289.493011:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782224289.493071:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782224289.497882:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1782224289.497908:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782224289.685756:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224289.687529:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312038656 00000100:00100000:3.0:1782224289.687552:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312038656 00000100:00100000:3.0:1782224289.687661:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 136 00000100:00100000:3.0:1782224289.687678:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+5:11002:x1868797312038656:12345-192.168.202.7@tcp:101:lsof.0 00010000:00010000:3.0:1782224289.687707:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224289.687737:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165225 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51752 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224289.687825:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16522c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224289.687844:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16522c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224289.687859:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16522c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224289.689949:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782224289.689965:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1782224289.691354:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16522c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224289.691741:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165225 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51752 expref: 7 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224289.691773:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16522c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51752 expref: 6 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224289.691784:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fd00) 00010000:00010000:3.0:1782224289.691787:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782224289.691792:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674400, rc 0) 00000100:00100000:3.0:1782224289.691919:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+6:11002:x1868797312038656:12345-192.168.202.7@tcp:101:lsof.0 Request processed in 4243us (6176us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224289.691931:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 136 00010000:00010000:1.0:1782224290.516456:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782224291.503843:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1782224291.503864:0:5808:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1782224291.503924:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1782224291.503935:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1782224291.542105:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224291.924868:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224291.924895:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e986bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333020288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782224291.924975:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224291.925152:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333020288 00000100:00100000:1.0:1782224291.925162:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333020288 00000100:00100000:1.0:1782224291.925245:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782224291.925255:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333020288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782224291.925299:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224291.925367:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333020288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224291.925374:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1782224291.925515:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782224291.925558:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e986bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333020288:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782224292.578394:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782224292.864710:0:12147:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:18:11 (1782224291) 00000100:00100000:2.0:1782224292.956835:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782224292.956858:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e986bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797333020416:0@lo:400:kworker.0 00000100:00100000:2.0:1782224292.957002:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224292.957189:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333020416 00000100:00100000:1.0:1782224292.957196:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333020416 00000100:00100000:1.0:1782224292.957245:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1782224292.957254:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797333020416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224292.957268:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e986bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797333020544:0@lo:400:kworker.0 00000100:00100000:2.0:1782224292.957297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224292.957300:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797333020416:12345-0@lo:400:kworker.0 Request processed in 48us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224292.957309:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1782224292.957314:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e986bbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333021056:0@lo:400:kworker.0 00000100:00100000:2.0:1782224292.957337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224292.957386:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e986bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797333020416:0@lo:400:kworker.0 00000100:00100000:2.0:1782224292.957402:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782224292.957408:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e986bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333020928:0@lo:400:kworker.0 00000100:00100000:1.0:1782224292.957427:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333021056 00000100:00100000:2.0:1782224292.957430:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224292.957431:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333021056 00000100:00100000:2.0:1782224292.957454:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333020544 00000100:00100000:2.0:1782224292.957457:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333020544 00000100:00100000:1.0:1782224292.957465:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782224292.957471:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333021056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224292.957494:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333020928 00000100:00100000:2.0:1782224292.957497:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333020928 00000100:00100000:1.0:1782224292.957519:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333021056:12345-0@lo:400:kworker.0 Request processed in 48us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224292.957526:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782224292.957816:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e986bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333020672:0@lo:400:kworker.0 00000100:00100000:3.0:1782224292.957849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224292.957875:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782224292.957881:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e986bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333020800:0@lo:400:kworker.0 00000100:00100000:3.0:1782224292.957901:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224292.958104:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333020672 00000100:00100000:1.0:1782224292.958109:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333020672 00000100:00100000:1.0:1782224292.958131:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1782224292.958138:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797333020544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224292.958174:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797333020544:12345-0@lo:400:kworker.0 Request processed in 34us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224292.958180:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1782224292.958202:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1782224292.958207:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333020672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224292.958233:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333020672:12345-0@lo:400:kworker.0 Request processed in 26us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224292.958239:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1782224292.958680:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e986bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333020672:0@lo:400:kworker.0 00000100:00100000:3.0:1782224292.958723:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333020800 00000100:00100000:3.0:1782224292.958734:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333020800 00000100:00100000:3.0:1782224292.958989:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782224292.958997:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333020800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224292.959052:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333020800:12345-0@lo:400:kworker.0 Request processed in 56us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224292.959059:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782224292.959092:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e986bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333020800:0@lo:400:kworker.0 00000100:00100000:2.0:1782224292.959158:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1782224292.959169:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797333020928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224292.959214:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797333020928:12345-0@lo:400:kworker.0 Request processed in 50us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224292.959221:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1782224292.959238:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782224292.959243:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782224292.959267:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e986bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333020928:0@lo:400:kworker.0 00000100:00100000:2.0:1782224292.959279:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e986bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797333020544:0@lo:400:kworker.0 00000100:00100000:2.0:1782224292.959289:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e986bbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333021056:0@lo:400:kworker.0 00000100:00100000:3.0:1782224293.396001:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224293.396094:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224293.396515:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312038784 00000100:00100000:0.0:1782224293.396525:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312038784 00000100:00100000:0.0:1782224293.396585:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 293 00000100:00100000:0.0:1782224293.396596:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2348:x1868797312038784:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224293.396675:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2348:x1868797312038784:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 81us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224293.396682:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 293 00000100:00100000:3.0:1782224293.396929:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224293.396960:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224293.396986:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224293.397059:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312039296 00000100:00100000:1.0:1782224293.397064:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312039296 00000100:00100000:1.0:1782224293.397102:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312038912 00000100:00100000:1.0:1782224293.397105:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312038912 00000100:00100000:1.0:1782224293.397127:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 151 00000100:00100000:1.0:1782224293.397148:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fff0e469-4c8f-4b03-af7c-046a658bf816+6:2348:x1868797312039296:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224293.397189:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fff0e469-4c8f-4b03-af7c-046a658bf816+6:2348:x1868797312039296:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 55us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224293.397196:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 151 00000100:00100000:1.0:1782224293.397211:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 152 00000100:00100000:1.0:1782224293.397216:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:2348:x1868797312038912:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224293.397238:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:2348:x1868797312038912:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 22us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224293.397244:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 152 00000100:00080000:1.0:1782224293.397260:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224293.400754:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312039040 00000100:00100000:2.0:1782224293.400770:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312039040 00000100:00100000:2.0:1782224293.400857:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312039168 00000100:00100000:2.0:1782224293.400860:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312039168 00000100:00100000:2.0:1782224293.400883:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 87 00000100:00100000:2.0:1782224293.400891:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2348:x1868797312039040:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224293.400961:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2348:x1868797312039040:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 69us (4866us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224293.400984:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 87 00000100:00100000:2.0:1782224293.401002:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 88 00000100:00100000:2.0:1782224293.401009:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2348:x1868797312039168:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224293.401055:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2348:x1868797312039168:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 46us (4068us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224293.401062:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 88 00000100:00080000:3.0:1782224293.401181:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782224293.401187:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782224293.461906:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabbbdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333021184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782224293.462065:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224293.462270:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333021184 00000100:00100000:1.0:1782224293.462279:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333021184 00000100:00100000:1.0:1782224293.462338:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782224293.462348:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333021184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782224293.462385:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224293.462517:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333021184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 170us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224293.462539:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782224293.462791:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabbbdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333021184:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782224293.588296:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224294.617367:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224294.915752:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224294.919371:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312039552 00000100:00100000:2.0:1782224294.919393:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312039552 00000100:00100000:2.0:1782224294.919506:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 137 00000100:00100000:2.0:1782224294.919521:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:11268:x1868797312039552:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782224294.919550:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224294.919581:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b165233 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51759 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.919691:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16523a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.919708:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16523a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.919724:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16523a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.919742:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165241 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.919750:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165241 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.919777:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165241 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.920543:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165248 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.920561:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165248 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.920570:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165248 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224294.920583:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1782224294.920823:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16523a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.920833:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16523a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.920840:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16523a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.920846:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaba00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224294.920851:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16523a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.920861:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16523a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.920877:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96eaa7d65800) 00010000:00010000:2.0:1782224294.920880:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224294.920893:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16523a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.920900:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16523a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.920915:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165241 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.920922:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165241 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.920928:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165241 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.920934:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbabe00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224294.920937:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165241 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.920943:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165241 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.920951:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96ea8635fa00) 00010000:00010000:2.0:1782224294.920953:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224294.920956:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165241 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.920962:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165241 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.921852:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b165233 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51759 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.921892:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165248 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51759 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.921902:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96ea87df7c00) 00010000:00010000:2.0:1782224294.921905:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224294.921909:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab800, rc 0) 00000100:00100000:2.0:1782224294.924608:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+15:11268:x1868797312039552:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 5074us (8854us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1782224294.924624:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 137 00000100:00100000:0.0:1782224294.943193:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224294.943252:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224294.943374:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312039680 00000100:00100000:1.0:1782224294.943388:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312039680 00000100:00100000:1.0:1782224294.943472:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 138 00000100:00100000:1.0:1782224294.943486:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+15:11268:x1868797312039680:12345-192.168.202.7@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1782224294.943645:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+15:11268:x1868797312039680:12345-192.168.202.7@tcp:59:lhsmtool_posix.0 Request processed in 162us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224294.943654:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 138 00000100:00100000:2.0:1782224294.943768:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312039808 00000100:00100000:2.0:1782224294.943773:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312039808 00000100:00100000:2.0:1782224294.943815:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:2.0:1782224294.943824:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8757cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+15:2347:x1868797312039808:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782224294.943840:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224294.943873:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165248 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51759 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224294.943898:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96ea87df7c00) 00010000:00010000:2.0:1782224294.943905:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224294.943943:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8757cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+14:2347:x1868797312039808:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 120us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224294.943950:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00000040:00080000:2.0:1782224295.641143:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782224295.641156:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782224295.641201:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1782224295.641216:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1782224295.643656:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782224296.647733:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:1.0:1782224296.663164:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224297.044566:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e986bbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333021312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782224297.044684:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224297.044912:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333021312 00000100:00100000:0.0:1782224297.044923:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333021312 00000100:00100000:0.0:1782224297.045060:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782224297.045072:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333021312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782224297.045135:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782224297.045289:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782224297.048896:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333021312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3812us (4199us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224297.048917:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782224297.049515:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e986bbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333021312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782224297.375386:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224297.375544:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312039936 00000100:00100000:1.0:1782224297.375558:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312039936 00000100:00100000:1.0:1782224297.375645:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 139 00000100:00100000:1.0:1782224297.375656:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:11310:x1868797312039936:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1782224297.375680:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224297.375706:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165256 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51760 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.375795:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16525d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.375812:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16525d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.375827:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16525d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.375865:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165264 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.375873:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.375880:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.376254:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16525d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.376263:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16525d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.376270:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16525d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.376277:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224297.376282:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16525d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.376290:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16525d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.376305:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fd00) 00010000:00010000:1.0:1782224297.376308:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224297.376312:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16525d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.376318:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16525d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.376339:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.376345:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165264 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.376352:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165264 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.376357:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224297.376359:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165264 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.376365:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165264 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.376371:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff96ea8508f300) 00010000:00010000:1.0:1782224297.376373:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224297.376375:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165264 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.376380:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165264 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.376414:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165256 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51760 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.376424:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fd00) 00010000:00010000:1.0:1782224297.376426:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224297.376444:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165256 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51760 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.376455:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d55400, rc 0) 00000100:00100000:1.0:1782224297.376527:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:11310:x1868797312039936:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 873us (1157us total) trans 0 rc 301/301 00000100:00100000:1.0:1782224297.376535:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 139 00000100:00080000:3.0:1782224297.376805:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224297.386619:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224297.388108:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312040192 00000100:00100000:1.0:1782224297.388126:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312040192 00000100:00100000:1.0:1782224297.388214:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 140 00000100:00100000:1.0:1782224297.388227:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:11310:x1868797312040192:12345-192.168.202.7@tcp:36:lfs.0 00010000:00010000:1.0:1782224297.388314:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224297.388353:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b164bd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51599 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.388381:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fd00) 00010000:00010000:1.0:1782224297.388387:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782224297.388747:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16526b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.388764:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16522c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51752 expref: 5 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.388773:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16526b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.388817:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16522c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51752 expref: 5 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.388849:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16522c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51752 expref: 5 pid: 5788 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224297.388866:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eac1d8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333021440:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224297.389009:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8352cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782224297.404596:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224297.404676:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312040320 00000100:00100000:3.0:1782224297.404688:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312040320 00010000:00010000:3.0:1782224297.404771:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16522c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51752 expref: 6 pid: 5788 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224297.404818:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 59 00000100:00100000:3.0:1782224297.404830:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fff0e469-4c8f-4b03-af7c-046a658bf816+6:2346:x1868797312040320:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224297.404863:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224297.404872:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16522c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51752 expref: 6 pid: 5788 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.404888:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16522c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51752 expref: 6 pid: 5788 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.404916:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fd00) 00010000:00010000:3.0:1782224297.404922:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16526b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.404933:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16526b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.404942:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16526b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.404973:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1782224297.405160:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224297.405353:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fff0e469-4c8f-4b03-af7c-046a658bf816+6:2346:x1868797312040320:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 523us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224297.405362:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 59 00010000:00010000:1.0:1782224297.409945:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16522c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51752 expref: 5 pid: 5788 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224297.410305:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eac1d8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333021440:192.168.202.7@tcp:104: 00010000:00010000:1.0:1782224297.410339:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16526b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.410352:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16526b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.410358:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16526b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.410391:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165272 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.410406:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165272 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.410419:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165272 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224297.416642:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1782224297.416676:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16526b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.416689:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16526b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.416697:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16526b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.416703:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224297.416709:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16526b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.416717:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16526b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.416739:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fd00) 00010000:00010000:1.0:1782224297.416742:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224297.416746:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16526b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.416752:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16526b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782224297.417053:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b59941a6 reply state 00000000cdf83d0b transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165272 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224297.417065:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782224297.417679:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+14:11310:x1868797312040192:12345-192.168.202.7@tcp:36:lfs.0 Request processed in 29447us (31067us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1782224297.417691:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 140 00010000:00010000:3.0:1782224297.425974:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165272 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.425995:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165272 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.426003:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165272 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.426073:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224297.426080:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165272 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.426090:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165272 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.426113:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff96ea8508f300) 00010000:00010000:3.0:1782224297.426116:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224297.426121:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165272 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.426129:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165272 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224297.619553:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224297.619614:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312040448 00000100:00100000:0.0:1782224297.619628:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312040448 00000100:00100000:0.0:1782224297.619695:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 141 00000100:00100000:0.0:1782224297.619706:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:11318:x1868797312040448:12345-192.168.202.7@tcp:101:lctl.0 00010000:00010000:0.0:1782224297.619738:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224297.619768:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165279 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51767 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.619859:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b165280 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.619878:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b165280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.619893:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b165280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224297.619978:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782224297.619983:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1782224297.620053:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b165280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.620198:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165279 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51767 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.620237:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b165280 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51767 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.620246:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96eaa7d65200) 00010000:00010000:0.0:1782224297.620249:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782224297.620253:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74000, rc 0) 00000100:00100000:0.0:1782224297.620328:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+14:11318:x1868797312040448:12345-192.168.202.7@tcp:101:lctl.0 Request processed in 624us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224297.620337:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 141 00000100:00100000:0.0:1782224297.675087:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224297.675257:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312040576 00000100:00100000:1.0:1782224297.675291:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312040576 00000100:00100000:1.0:1782224297.675377:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 142 00000100:00100000:1.0:1782224297.675400:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+14:11324:x1868797312040576:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1782224297.675429:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224297.675465:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165287 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5176e expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.675544:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16528e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.675561:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16528e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.675574:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16528e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.675589:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165295 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.675595:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.675602:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.676194:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b16529c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.676220:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b16529c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.676234:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b16529c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224297.676328:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1782224297.676333:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782224297.676361:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b16529c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.676376:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16528e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.676384:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16528e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.676391:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16528e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.676397:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224297.676402:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16528e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.676410:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16528e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.676426:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96eaa7d65200) 00010000:00010000:1.0:1782224297.676429:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224297.676448:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16528e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.676454:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16528e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.676471:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.676489:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165295 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.676495:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.676500:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224297.676504:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.676510:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165295 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.676520:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff96ea8508f900) 00010000:00010000:1.0:1782224297.676523:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224297.676526:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165295 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.677310:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165295 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.677364:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165287 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5176e expref: 16 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.677380:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b16529c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5176e expref: 15 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.677388:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:1.0:1782224297.677390:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782224297.677402:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d54600, rc 0) 00000100:00100000:0.0:1782224297.681637:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+15:11324:x1868797312040576:12345-192.168.202.7@tcp:101:bash.0 Request processed in 6227us (6543us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224297.681651:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 142 00010000:00010000:0.0:1782224297.684559:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224297.689871:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224297.690092:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312040832 00000100:00100000:2.0:1782224297.690107:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312040832 00000100:00100000:2.0:1782224297.690182:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 143 00000100:00100000:2.0:1782224297.690195:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+15:11324:x1868797312040832:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:2.0:1782224297.690223:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224297.690249:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1652a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51775 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.690444:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1652aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.690462:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1652aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.690481:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1652aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.690690:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1652b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.690717:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1652b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.690729:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1652b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782224297.692655:0:5787:0:(osp_object.c:1673:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1782224297.693137:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1652b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.693154:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1652b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.693165:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1652b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.693202:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1652aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.693210:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1652aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.693217:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1652aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.693223:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224297.693240:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1652aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.693249:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1652aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.693263:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:2.0:1782224297.693267:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224297.693272:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1652aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.693291:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b1652aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782224297.693305:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000011f9a167 reply state 00000000ca1757b8 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1652b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224297.693315:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782224297.693352:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1652a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51775 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.693367:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1652b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51775 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.693375:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8635fe00) 00010000:00010000:2.0:1782224297.693377:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782224297.693379:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab000, rc 0) 00000100:00100000:2.0:1782224297.693468:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:11324:x1868797312040832:12345-192.168.202.7@tcp:101:bash.0 Request processed in 3275us (3612us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1782224297.693477:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 143 00010000:00010000:3.0:1782224297.699344:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1652b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224297.699350:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:3.0:1782224297.699364:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1652b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.699371:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1652b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.699376:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224297.699381:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1652b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.699388:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1652b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.699423:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96ea8635f200) 00010000:00010000:3.0:1782224297.699427:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224297.699442:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1652b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.699504:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1652b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224297.699646:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312040960 00000100:00100000:1.0:1782224297.699659:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312040960 00000100:00100000:1.0:1782224297.699735:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00100000:1.0:1782224297.699743:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2347:x1868797312040960:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1782224297.699760:0:6585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224297.699776:0:6585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000242318a/0xcfd8b3ae4b1652c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5177c expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782224297.699796:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1782224297.699801:0:6585:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224297.699818:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:1.0:1782224297.699821:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224297.699828:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000242318a/0xcfd8b3ae4b1652c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5177c expref: 6 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.699843:0:6585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000242318a/0xcfd8b3ae4b1652c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5177c expref: 6 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.699962:0:6585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d55800, rc 0) 00000100:00100000:1.0:1782224297.700036:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797312040960:12345-192.168.202.7@tcp:101:bash.0 Request processed in 293us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224297.700041:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00100000:0.0:1782224297.709182:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224297.709374:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312041088 00000100:00100000:3.0:1782224297.709384:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312041088 00000100:00100000:3.0:1782224297.709456:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:3.0:1782224297.709468:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:11324:x1868797312041088:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:3.0:1782224297.709488:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224297.709507:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008511a858/0xcfd8b3ae4b1652cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51783 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.709538:0:6715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000242318a/0xcfd8b3ae4b1652c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5177c expref: 7 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.709546:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782224297.709550:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782224297.709555:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008511a858/0xcfd8b3ae4b1652cd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51783 expref: 7 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.709588:0:6715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000242318a/0xcfd8b3ae4b1652c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5177c expref: 7 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.709622:0:6715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000242318a/0xcfd8b3ae4b1652c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5177c expref: 7 pid: 6585 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224297.709636:0:6715:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e986bbdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6715:1868797333021568:192.168.202.7@tcp:104: 00000100:00100000:3.0:1782224297.709747:0:6715:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa7a0f300 going to sleep for 11 seconds 00000100:00100000:3.0:1782224297.712247:0:6715:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e986bbdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6715:1868797333021568:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224297.712280:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008511a858/0xcfd8b3ae4b1652cd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51783 expref: 7 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.712301:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675c00, rc 0) 00000100:00100000:3.0:1782224297.712380:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:11324:x1868797312041088:12345-192.168.202.7@tcp:101:bash.0 Request processed in 2914us (3208us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224297.712388:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:2.0:1782224297.714743:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224297.714872:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312041216 00000100:00100000:0.0:1782224297.714883:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312041216 00010000:00010000:0.0:1782224297.714927:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000242318a/0xcfd8b3ae4b1652c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5177c expref: 7 pid: 6585 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224297.714978:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 60 00000100:00100000:0.0:1782224297.714988:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312041216:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224297.715004:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224297.715052:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000242318a/0xcfd8b3ae4b1652c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5177c expref: 7 pid: 6585 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.715087:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000242318a/0xcfd8b3ae4b1652c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5177c expref: 7 pid: 6585 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.715111:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000242318a/0xcfd8b3ae4b1652c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5177c expref: 7 pid: 6585 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.715131:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224297.715135:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224297.715144:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008511a858/0xcfd8b3ae4b1652cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51783 expref: 6 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.715155:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008511a858/0xcfd8b3ae4b1652cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51783 expref: 6 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.715197:0:5770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008511a858/0xcfd8b3ae4b1652cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51783 expref: 6 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224297.715212:0:5770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5770:1868797333021696:192.168.202.7@tcp:105: 00000100:00100000:0.0:1782224297.715349:0:5770:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfda80 going to sleep for 11 seconds 00000100:00100000:0.0:1782224297.732703:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224297.733704:0:5770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5770:1868797333021696:192.168.202.7@tcp:105: 00010000:00010000:2.0:1782224297.733731:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224297.733801:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2346:x1868797312041216:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 18814us (19069us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224297.733813:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 60 00000100:00100000:1.0:1782224297.733966:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312041472 00000100:00100000:1.0:1782224297.733974:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312041472 00000100:00100000:1.0:1782224297.734055:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00100000:1.0:1782224297.734065:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+17:11324:x1868797312041472:12345-192.168.202.7@tcp:35:bash.0 00000100:00100000:1.0:1782224297.734412:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:11324:x1868797312041472:12345-192.168.202.7@tcp:35:bash.0 Request processed in 348us (1717us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1782224297.734447:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00100000:2.0:1782224297.857003:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224297.857240:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312041728 00000100:00100000:3.0:1782224297.857251:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312041728 00000100:00100000:3.0:1782224297.857315:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 144 00000100:00100000:3.0:1782224297.857325:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:11334:x1868797312041728:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1782224297.857350:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224297.857842:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1652d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5178a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224297.859107:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1782224297.862308:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1652d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5178a expref: 20 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.862335:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96eaa7d65200) 00010000:00010000:2.0:1782224297.862338:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782224297.862348:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1652d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5178a expref: 20 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224297.862372:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674800, rc 0) 00000100:00100000:2.0:1782224297.862471:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+19:11334:x1868797312041728:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 5146us (5475us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1782224297.862480:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 144 00000100:00100000:0.0:1782224297.867068:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224297.867535:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312041984 00000100:00100000:3.0:1782224297.867545:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312041984 00000100:00100000:3.0:1782224297.867683:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00100000:3.0:1782224297.867696:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+19:11334:x1868797312041984:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1782224297.867963:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+20:11334:x1868797312041984:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 269us (903us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1782224297.867971:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00100000:0.0:1782224297.973833:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224297.974099:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312042112 00000100:00100000:1.0:1782224297.974115:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312042112 00000100:00100000:1.0:1782224297.974200:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 145 00000100:00100000:1.0:1782224297.974213:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+20:11340:x1868797312042112:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1782224297.974246:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224297.974273:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1652e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51791 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.974361:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b1652e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.974378:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b1652e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.974392:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b1652e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224297.974484:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1782224297.974488:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782224297.974519:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b1652e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.974551:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1652e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51791 expref: 22 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.974574:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b1652e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51791 expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224297.974609:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:1.0:1782224297.974612:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782224297.974617:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d54200, rc 0) 00000100:00100000:1.0:1782224297.974698:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+21:11340:x1868797312042112:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 487us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224297.974706:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 145 00000100:00100000:2.0:1782224297.985157:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224297.986120:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312042368 00000100:00100000:0.0:1782224297.986136:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312042368 00000100:00100000:0.0:1782224297.986222:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 146 00000100:00100000:0.0:1782224297.986255:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+21:11340:x1868797312042368:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1782224297.986283:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224297.986308:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b1652f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51798 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.986460:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b1652f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.986478:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b1652f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.986491:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b1652f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224297.986504:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1782224297.986669:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b1652f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51798 expref: 24 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.986689:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b1652f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51798 expref: 23 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.986699:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8635fe00) 00010000:00010000:0.0:1782224297.986703:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782224297.986706:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74800, rc 0) 00000100:00100000:0.0:1782224297.986813:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+23:11340:x1868797312042368:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 561us (1672us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1782224297.986821:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 146 00000100:00100000:0.0:1782224297.990903:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224297.991078:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312042496 00000100:00100000:3.0:1782224297.991091:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312042496 00000100:00100000:3.0:1782224297.991174:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:3.0:1782224297.991187:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+23:2347:x1868797312042496:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224297.991209:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224297.991242:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b1652f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51798 expref: 23 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224297.991268:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8635fe00) 00010000:00010000:3.0:1782224297.991274:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224297.991346:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+22:2347:x1868797312042496:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 162us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224297.991355:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:3.0:1782224297.997722:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224297.997805:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312042752 00000100:00100000:1.0:1782224297.997816:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312042752 00000100:00100000:1.0:1782224297.997878:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 147 00000100:00100000:1.0:1782224297.997887:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+22:11340:x1868797312042752:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1782224297.997915:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224297.997937:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165305 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5179f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.998415:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b16530c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.998463:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b16530c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.998478:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b16530c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224297.998496:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1782224297.998669:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165305 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5179f expref: 25 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.998690:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b16530c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5179f expref: 24 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224297.998700:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8635fe00) 00010000:00010000:0.0:1782224297.998703:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782224297.998708:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74c00, rc 0) 00000100:00100000:0.0:1782224297.998797:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+24:11340:x1868797312042752:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 910us (1087us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1782224297.998805:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 147 00000100:00100000:2.0:1782224298.012106:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224298.012300:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312042880 00000100:00100000:3.0:1782224298.012313:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312042880 00000100:00100000:3.0:1782224298.012383:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:3.0:1782224298.012395:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2346:x1868797312042880:12345-192.168.202.7@tcp:1:lfs.0 00010000:00010000:3.0:1782224298.012467:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16531a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.012519:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008511a858/0xcfd8b3ae4b1652cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51783 expref: 6 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.012529:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782224298.012533:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782224298.012539:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16531a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.012585:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008511a858/0xcfd8b3ae4b1652cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51783 expref: 6 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.012602:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008511a858/0xcfd8b3ae4b1652cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51783 expref: 6 pid: 6715 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224298.012695:0:6584:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e986bbe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6584:1868797333021824:192.168.202.7@tcp:104: 00000100:00100000:3.0:1782224298.012826:0:6584:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa7a0f300 going to sleep for 11 seconds 00000100:00100000:1.0:1782224298.017442:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224298.017563:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312043008 00000100:00100000:0.0:1782224298.017576:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312043008 00002000:00100000:0.0:1782224298.017722:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff96eac1d8f800 x1868797312043008/t0(0) o4->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:754/0 lens 504/0 e 0 to 0 dl 1782224309 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782224298.017734:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96eac1d8f800 with x1868797312043008 ext(0->12) 00010000:00010000:0.0:1782224298.017747:0:6588:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008511a858/0xcfd8b3ae4b1652cd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51783 expref: 7 pid: 6715 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.017801:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008511a858/0xcfd8b3ae4b1652cd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51783 expref: 7 pid: 6715 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782224298.017810:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff96eac1d8f800 00000100:00100000:0.0:1782224298.017850:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:0.0:1782224298.017861:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312043008:12345-192.168.202.7@tcp:4:lfs.0 00000100:00100000:0.0:1782224298.019089:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:2346:x1868797312043008:12345-192.168.202.7@tcp:4:lfs.0 Request processed in 1220us (1661us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1782224298.019102:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 2 00002000:00100000:0.0:1782224298.019113:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff96eac1d8f800 x1868797312043008/t4294967305(0) o4->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:754/0 lens 504/448 e 0 to 0 dl 1782224309 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782224298.019123:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96eac1d8f800 with x1868797312043008 ext(0->12) 00010000:00010000:0.0:1782224298.019132:0:6588:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008511a858/0xcfd8b3ae4b1652cd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51783 expref: 9 pid: 6715 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.019150:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008511a858/0xcfd8b3ae4b1652cd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51783 expref: 9 pid: 6715 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782224298.019157:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff96eac1d8f800 00000100:00100000:3.0:1782224298.019509:0:6584:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e986bbe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6584:1868797333021824:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224298.019539:0:6584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16531a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224298.023235:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224298.023350:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312043136 00000100:00100000:1.0:1782224298.023361:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312043136 00010000:00010000:1.0:1782224298.023412:0:8291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008511a858/0xcfd8b3ae4b1652cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51783 expref: 9 pid: 6715 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224298.023477:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00100000:1.0:1782224298.023489:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:2349:x1868797312043136:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782224298.023512:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1782224298.023537:0:8291:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1782224298.023540:0:8291:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782224297 00002000:00010000:1.0:1782224298.023554:0:8291:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1782224297 00002000:00010000:1.0:1782224298.023557:0:8291:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1782224297 00010000:00010000:1.0:1782224298.023565:0:8291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008511a858/0xcfd8b3ae4b1652cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51783 expref: 9 pid: 6715 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224298.023581:0:8291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008511a858/0xcfd8b3ae4b1652cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51783 expref: 9 pid: 6715 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224298.023612:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008511a858/0xcfd8b3ae4b1652cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51783 expref: 9 pid: 6715 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224298.023711:0:8291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782224298.023715:0:8291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782224298.023722:0:8291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16531a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224298.023733:0:8291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16531a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224298.023828:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224298.023899:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2349:x1868797312043136:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 411us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224298.023908:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 61 00010000:00010000:3.0:1782224298.025215:0:6584:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16531a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.025235:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16531a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.025291:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16531a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.025300:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16531a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.025309:0:6584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16531a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.025316:0:6584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674600 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224298.025321:0:6584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16531a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.025330:0:6584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16531a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.025348:0:6584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16531a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.025355:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2dc3679/0xcfd8b3ae4b16531a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224298.025477:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312042880:12345-192.168.202.7@tcp:1:lfs.0 Request processed in 13079us (13379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224298.025488:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:0.0:1782224298.029546:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224298.029727:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312043392 00000100:00100000:2.0:1782224298.029740:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312043392 00000100:00100000:2.0:1782224298.029815:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 38 00000100:00100000:2.0:1782224298.029828:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea9c44fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+24:11340:x1868797312043392:12345-192.168.202.7@tcp:35:lfs.0 00000004:00010000:2.0:1782224298.029924:0:5789:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b16530c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5179f expref: 24 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782224298.030755:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1782224298.030804:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1782224298.033118:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1782224298.033256:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165321 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.033286:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1652b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51775 expref: 28 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.033309:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165321 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.033364:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1652b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51775 expref: 28 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.033384:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1652b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51775 expref: 28 pid: 5787 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224298.033403:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eac1d8b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5789:1868797333021952:192.168.202.7@tcp:104: 00000100:00100000:2.0:1782224298.033815:0:5789:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabf41c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224298.039219:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224298.039298:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312043520 00000100:00100000:3.0:1782224298.039311:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312043520 00010000:00010000:3.0:1782224298.039363:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1652b8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51775 expref: 29 pid: 5787 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224298.039416:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 62 00000100:00100000:3.0:1782224298.039436:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+29:2347:x1868797312043520:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224298.039460:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224298.039469:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1652b8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51775 expref: 29 pid: 5787 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.039484:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1652b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51775 expref: 29 pid: 5787 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.039512:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8635fe00) 00010000:00010000:3.0:1782224298.039518:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165321 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.039530:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165321 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.039538:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165321 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.039558:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224298.039668:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+29:2347:x1868797312043520:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 241us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224298.039677:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 62 00010000:00010000:0.0:1782224298.039856:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b1652b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51775 expref: 28 pid: 5787 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224298.039899:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eac1d8b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5789:1868797333021952:192.168.202.7@tcp:104: 00010000:00010000:0.0:1782224298.039924:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165321 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.039935:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165321 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.039951:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165321 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782224298.040361:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1782224298.040602:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1782224298.040735:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabccbad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1868797333022080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782224298.040818:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224298.040863:0:5789:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782224298.041072:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333022080 00000100:00100000:3.0:1782224298.041094:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333022080 00000100:00100000:3.0:1782224298.041145:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782224298.041154:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5789:x1868797333022080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1782224298.041247:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5789:x1868797333022080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 94us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224298.041255:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782224298.041296:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabccbad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1868797333022080:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1782224298.044240:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1782224298.044377:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e986bbe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1868797333022208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1782224298.044499:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224298.044595:0:5789:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa7a0f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224298.044736:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333022208 00000100:00100000:2.0:1782224298.044747:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333022208 00000100:00100000:2.0:1782224298.044919:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782224298.044931:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5789:x1868797333022208:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782224298.045220:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5789:x1868797333022208:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 290us (721us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1782224298.045230:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782224298.045321:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e986bbe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1868797333022208:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1782224298.045391:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1782224298.045453:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165321 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.045467:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165321 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.045476:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165321 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.045483:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbabe00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224298.045489:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165321 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.045498:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165321 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.045534:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8635fe00) 00010000:00010000:3.0:1782224298.045538:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1782224298.045545:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165321 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.045552:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165321 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782224298.045837:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1782224298.045992:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1782224298.046007:0:5789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378825991735ns, next at 379825988665ns, rc = 0 00000001:00080000:3.0:1782224298.046063:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1782224298.046108:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8635fe00) 00010000:00010000:3.0:1782224298.046111:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1782224298.046120:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b16530c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5179f expref: 32 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224298.046250:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea9c44fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+31:11340:x1868797312043392:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 16425us (16720us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1782224298.046261:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 38 00000020:00080000:3.0:1782224298.046266:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1782224298.049882:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224298.050297:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312043648 00000100:00100000:0.0:1782224298.050311:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312043648 00000100:00100000:0.0:1782224298.050378:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 148 00000100:00100000:0.0:1782224298.050389:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+31:11340:x1868797312043648:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1782224298.050422:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224298.050462:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165328 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a517a6 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.050549:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165328 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517a6 expref: 32 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.050567:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165328 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517a6 expref: 32 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.050613:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:0.0:1782224298.050617:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782224298.050621:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74e00, rc 0) 00000100:00100000:0.0:1782224298.050710:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+32:11340:x1868797312043648:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 321us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224298.050718:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 148 00000100:00100000:1.0:1782224298.055671:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224298.055801:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312043904 00000100:00100000:2.0:1782224298.055814:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312043904 00000100:00100000:2.0:1782224298.055889:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:2.0:1782224298.055902:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+32:11340:x1868797312043904:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:2.0:1782224298.056288:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+33:11340:x1868797312043904:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 388us (633us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1782224298.056318:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:0.0:1782224298.073337:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1868797333022720:0@lo:400:kworker.0 00000100:00100000:0.0:1782224298.073464:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224298.073541:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782224298.073548:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabccbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797333022592:0@lo:400:kworker.0 00000100:00100000:0.0:1782224298.073575:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224298.073614:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333022720 00000100:00100000:0.0:1782224298.073624:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333022720 00000100:00100000:0.0:1782224298.073689:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333022592 00000100:00100000:0.0:1782224298.073692:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333022592 00000100:00100000:0.0:1782224298.073725:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782224298.073735:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868797333022720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224298.073814:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868797333022720:12345-0@lo:400:kworker.0 Request processed in 79us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224298.073822:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782224298.073844:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782224298.073851:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797333022592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224298.073880:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797333022592:12345-0@lo:400:kworker.0 Request processed in 30us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224298.073887:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782224298.074080:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabccbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797333022336:0@lo:400:kworker.0 00000100:00100000:3.0:1782224298.074123:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224298.074158:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333022848:0@lo:400:kworker.0 00000100:00100000:3.0:1782224298.074189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224298.074211:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782224298.074226:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabccb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333022464:0@lo:400:kworker.0 00000100:00100000:3.0:1782224298.074254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224298.074284:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333022336 00000100:00100000:3.0:1782224298.074288:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333022336 00000100:00100000:3.0:1782224298.074320:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1782224298.074327:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797333022336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224298.074363:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797333022336:12345-0@lo:400:kworker.0 Request processed in 36us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224298.074369:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1782224298.074406:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333022848 00000100:00100000:3.0:1782224298.074410:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333022848 00000100:00100000:3.0:1782224298.074454:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782224298.074462:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333022848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224298.074497:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333022848:12345-0@lo:400:kworker.0 Request processed in 36us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224298.074503:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1782224298.074524:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782224298.074530:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224298.074549:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabccbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797333022336:0@lo:400:kworker.0 00000100:00100000:3.0:1782224298.074562:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333022848:0@lo:400:kworker.0 00000100:00100000:3.0:1782224298.074592:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333022464 00000100:00100000:3.0:1782224298.074595:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333022464 00000100:00100000:3.0:1782224298.074614:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1782224298.074619:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333022464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224298.074655:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333022464:12345-0@lo:400:kworker.0 Request processed in 36us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224298.074672:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1782224298.074698:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabccb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333022464:0@lo:400:kworker.0 00000100:00100000:0.0:1782224298.074869:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabccbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797333022592:0@lo:400:kworker.0 00000100:00100000:0.0:1782224298.074888:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1868797333022720:0@lo:400:kworker.0 00000100:00100000:3.0:1782224298.148095:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224298.148287:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312044160 00000100:00100000:0.0:1782224298.148301:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312044160 00000100:00100000:0.0:1782224298.148379:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 149 00000100:00100000:0.0:1782224298.148391:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+33:11350:x1868797312044160:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1782224298.148439:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224298.148472:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b16532f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a517ad expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224298.148663:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1782224298.148856:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b16532f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517ad expref: 35 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.148876:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96eaa7d65200) 00010000:00010000:0.0:1782224298.148879:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782224298.148885:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b16532f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517ad expref: 35 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.148902:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74200, rc 0) 00000100:00100000:0.0:1782224298.149000:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+34:11350:x1868797312044160:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 611us (919us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1782224298.149008:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 149 00000100:00100000:0.0:1782224298.154656:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224298.155659:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312044288 00000100:00100000:2.0:1782224298.155674:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312044288 00000100:00100000:2.0:1782224298.155820:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 150 00000100:00100000:2.0:1782224298.155842:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+34:11350:x1868797312044288:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:2.0:1782224298.155967:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16533d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.155992:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16533d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156007:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16533d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156057:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165344 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156066:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156074:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156217:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b16534b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156238:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b16534b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156246:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b16534b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782224298.156324:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b16534b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156340:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16533d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156347:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16533d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156355:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16533d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156361:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224298.156366:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16533d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156374:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16533d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156389:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:2.0:1782224298.156393:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224298.156399:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16533d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156404:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16533d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156418:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156424:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165344 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156448:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156453:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224298.156457:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156464:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165344 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156472:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96ea8635fc00) 00010000:00010000:2.0:1782224298.156475:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224298.156478:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165344 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156484:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165344 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156502:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b16534b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156508:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b16534b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156515:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b16534b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156520:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbabe00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224298.156523:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b16534b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156541:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b16534b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156550:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:2.0:1782224298.156553:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224298.156556:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b16534b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.156563:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b16534b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224298.156674:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+34:11350:x1868797312044288:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 843us (2030us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224298.156684:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 150 00000100:00100000:2.0:1782224298.161124:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224298.161322:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312044544 00000100:00100000:3.0:1782224298.161336:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312044544 00000100:00100000:3.0:1782224298.161406:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 40 00000100:00100000:3.0:1782224298.161417:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+34:11350:x1868797312044544:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1782224298.166875:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+35:11350:x1868797312044544:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 5366us (5842us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1782224298.166896:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 40 00000100:00100000:3.0:1782224298.212673:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224298.214057:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312044800 00000100:00100000:0.0:1782224298.214073:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312044800 00000100:00100000:0.0:1782224298.214202:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 151 00000100:00100000:0.0:1782224298.214245:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+35:11353:x1868797312044800:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1782224298.214277:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224298.214303:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b165352 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a517b4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.214404:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165359 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.214420:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165359 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.214445:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165359 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.214463:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b165360 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.214471:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b165360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.214478:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b165360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.214652:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b165367 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.214662:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b165367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.214669:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b165367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224298.214692:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1782224298.214844:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165359 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.214853:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165359 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.214860:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165359 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.214867:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224298.214872:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165359 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.214879:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165359 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.214893:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:0.0:1782224298.214897:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224298.214902:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165359 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.214909:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165359 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.214924:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b165360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.214930:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b165360 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.215174:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b165360 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.215179:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75000 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224298.215182:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b165360 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.215189:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b165360 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.215199:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96eaa7d65c00) 00010000:00010000:0.0:1782224298.215201:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224298.215205:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b165360 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.215210:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b165360 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.215274:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b165352 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517b4 expref: 38 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.215291:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b165367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517b4 expref: 37 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.215298:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:0.0:1782224298.215301:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782224298.215304:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a75e00, rc 0) 00000100:00100000:0.0:1782224298.215382:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+37:11353:x1868797312044800:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1141us (2727us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1782224298.215399:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 151 00000100:00100000:2.0:1782224298.219480:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224298.219701:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312044928 00000100:00100000:3.0:1782224298.219717:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312044928 00000100:00100000:3.0:1782224298.219815:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 152 00000100:00100000:3.0:1782224298.219828:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+37:11353:x1868797312044928:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:3.0:1782224298.219916:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165375 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.219937:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.219962:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.219997:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.220005:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165375 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.220074:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165375 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.220081:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224298.220086:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165375 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.220096:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165375 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.220113:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:3.0:1782224298.220117:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782224298.220124:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165375 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224298.220131:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165375 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224298.220503:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+37:11353:x1868797312044928:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 676us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224298.220512:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 152 00000100:00100000:2.0:1782224298.223284:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224298.223417:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312045184 00000100:00100000:3.0:1782224298.223441:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312045184 00000100:00100000:3.0:1782224298.223510:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 41 00000100:00100000:3.0:1782224298.223521:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+37:11353:x1868797312045184:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1782224298.223839:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+38:11353:x1868797312045184:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 318us (568us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1782224298.223848:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 41 00000100:00100000:3.0:1782224298.510487:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224298.510611:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224298.510949:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224298.511079:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312045568 00000100:00100000:0.0:1782224298.511093:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312045568 00000100:00100000:0.0:1782224298.511178:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 156 00000100:00100000:0.0:1782224298.511190:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2347:x1868797312045568:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224298.511299:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2347:x1868797312045568:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 110us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224298.511307:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 156 00000100:00100000:2.0:1782224298.511484:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312045440 00000100:00100000:2.0:1782224298.511490:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312045440 00000100:00100000:2.0:1782224298.511548:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 90 00000100:00100000:2.0:1782224298.511556:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797312045440:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224298.511596:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797312045440:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 42us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224298.511602:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 90 00000100:00080000:0.0:1782224298.512534:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782224298.515635:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312045312 00000100:00100000:1.0:1782224298.515659:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312045312 00000100:00100000:1.0:1782224298.515781:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 295 00000100:00100000:1.0:1782224298.516389:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2347:x1868797312045312:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224298.516529:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2347:x1868797312045312:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 736us (6114us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224298.516539:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 295 00000100:00100000:2.0:1782224298.588620:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333022976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782224298.588733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224298.588942:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333022976 00000100:00100000:1.0:1782224298.588953:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333022976 00000100:00100000:1.0:1782224298.589067:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782224298.589079:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333022976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782224298.589138:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224298.593321:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333022976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4229us (4572us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224298.593341:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782224298.593494:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333022976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782224298.639659:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224298.640000:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312045824 00000100:00100000:2.0:1782224298.640143:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312045824 00000100:00100000:2.0:1782224298.640306:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 153 00000100:00100000:2.0:1782224298.640320:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+38:11384:x1868797312045824:12345-192.168.202.7@tcp:101:cat.0 00010000:00010000:2.0:1782224298.640352:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224298.640378:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16537c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a517bb expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.640519:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b165383 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.640537:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b165383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.640552:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b165383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224298.640565:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1782224298.640720:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16537c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517bb expref: 41 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.640743:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b165383 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517bb expref: 40 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.640764:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:2.0:1782224298.640767:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782224298.640771:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab000, rc 0) 00000100:00100000:2.0:1782224298.641375:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+40:11384:x1868797312045824:12345-192.168.202.7@tcp:101:cat.0 Request processed in 1055us (1726us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1782224298.641401:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 153 00000100:00100000:3.0:1782224298.646894:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224298.647243:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312045952 00000100:00100000:1.0:1782224298.647255:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312045952 00000100:00100000:1.0:1782224298.647336:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:1.0:1782224298.647347:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+40:2346:x1868797312045952:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782224298.647369:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224298.647402:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b165383 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517bb expref: 40 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224298.647436:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:1.0:1782224298.647442:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224298.647510:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+39:2346:x1868797312045952:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 164us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224298.647518:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:1.0:1782224298.652726:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224298.652833:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312046208 00000100:00100000:3.0:1782224298.652847:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312046208 00000100:00100000:3.0:1782224298.652923:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 42 00000100:00100000:3.0:1782224298.652945:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+39:11384:x1868797312046208:12345-192.168.202.7@tcp:35:cat.0 00000100:00100000:3.0:1782224298.653887:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+40:11384:x1868797312046208:12345-192.168.202.7@tcp:35:cat.0 Request processed in 950us (1171us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1782224298.653897:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 42 00010000:00010000:1.0:1782224298.710276:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224298.755857:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224298.756270:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312046464 00000100:00100000:0.0:1782224298.756299:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312046464 00000100:00100000:0.0:1782224298.756379:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 154 00000100:00100000:0.0:1782224298.756392:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+40:11390:x1868797312046464:12345-192.168.202.7@tcp:101:dd.0 00010000:00010000:0.0:1782224298.756435:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224298.756439:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782224298.756478:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b1652e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51791 expref: 40 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.756504:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:0.0:1782224298.756511:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782224298.756529:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b165391 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a517c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.756657:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165398 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.756675:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b165367 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517b4 expref: 40 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.756702:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165398 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.756747:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b165367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517b4 expref: 40 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.756764:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b165367 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517b4 expref: 40 pid: 5787 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224298.756781:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea88af4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333023104:192.168.202.7@tcp:104: 00000100:00100000:0.0:1782224298.756924:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782224298.759722:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea88af4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333023104:192.168.202.7@tcp:104: 00010000:00010000:0.0:1782224298.759761:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165398 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224298.762930:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224298.765468:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312046592 00000100:00100000:1.0:1782224298.765490:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312046592 00010000:00010000:1.0:1782224298.765573:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b165367 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517b4 expref: 41 pid: 5787 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224298.765634:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 63 00000100:00100000:1.0:1782224298.765646:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8757d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+41:2347:x1868797312046592:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782224298.765669:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224298.765676:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b165367 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517b4 expref: 41 pid: 5787 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224298.765692:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b165367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517b4 expref: 41 pid: 5787 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224298.765721:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b165367 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517b4 expref: 41 pid: 5787 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224298.765740:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:1.0:1782224298.765745:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165398 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224298.765757:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165398 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224298.765766:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165398 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224298.765813:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224298.765900:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165398 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224298.765901:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8757d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+40:2347:x1868797312046592:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 256us (2985us total) trans 0 rc 0/0 00010000:00010000:2.0:1782224298.765909:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165398 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224298.765931:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 63 00000004:00200000:2.0:1782224298.765933:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1782224298.766183:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b165391 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517c2 expref: 41 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.766202:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165398 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517c2 expref: 40 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224298.766211:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:2.0:1782224298.766214:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782224298.766217:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74600, rc 0) 00000100:00100000:2.0:1782224298.766246:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+40:11390:x1868797312046464:12345-192.168.202.7@tcp:101:dd.0 Request processed in 9857us (10406us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1782224298.766254:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 154 00000100:00100000:2.0:1782224298.773912:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224298.774087:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312046848 00000100:00100000:0.0:1782224298.774100:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312046848 00000100:00100000:0.0:1782224298.774189:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 155 00000100:00100000:0.0:1782224298.774201:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+40:11390:x1868797312046848:12345-192.168.202.7@tcp:36:dd.0 00010000:00010000:0.0:1782224298.774831:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1653a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.774855:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1653a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.774871:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1653a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782224298.774965:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1782224298.774993:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd359f7a reply state 00000000c4d52201 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1653a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224298.775004:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782224298.775505:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+43:11390:x1868797312046848:12345-192.168.202.7@tcp:36:dd.0 Request processed in 1301us (1601us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1782224298.775514:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 155 00000020:00080000:0.0:1782224298.775520:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782224298.778865:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1653a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.778889:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1653a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.778898:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1653a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.778905:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224298.778911:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1653a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.778920:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1653a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.779001:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:0.0:1782224298.779005:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224298.779012:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1653a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224298.779064:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1653a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224299.083079:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224299.083715:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312046976 00000100:00100000:3.0:1782224299.083731:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312046976 00000100:00100000:3.0:1782224299.083890:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 156 00000100:00100000:3.0:1782224299.083904:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+42:11405:x1868797312046976:12345-192.168.202.7@tcp:101:stat.0 00010000:00010000:3.0:1782224299.083939:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224299.083966:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b1653ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a517c9 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.084096:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b1653b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.084126:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b1653b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.084452:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b1653b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.084492:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b1653bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.084501:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b1653bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.084509:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b1653bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.084646:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1653c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.084658:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165398 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517c2 expref: 43 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.084668:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1653c2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.084719:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165398 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517c2 expref: 43 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.084735:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165398 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517c2 expref: 43 pid: 5788 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224299.084754:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1868797333023232:192.168.202.7@tcp:104: 00000100:00100000:3.0:1782224299.084890:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabfca1600 going to sleep for 11 seconds 00000100:00100000:3.0:1782224299.090275:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224299.090537:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312047232 00000100:00100000:3.0:1782224299.090550:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312047232 00000100:00100000:3.0:1782224299.090642:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00100000:3.0:1782224299.090655:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+44:5562:x1868797312047232:12345-192.168.202.7@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782224299.091792:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+45:5562:x1868797312047232:12345-192.168.202.7@tcp:35:ldlm_bl.0 Request processed in 1131us (1524us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1782224299.091805:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00100000:2.0:1782224299.091959:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1868797333023232:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224299.091991:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1653c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782224299.092091:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224299.095349:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224299.098747:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312047360 00000100:00100000:2.0:1782224299.098792:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312047360 00010000:00010000:2.0:1782224299.098862:0:8291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165398 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517c2 expref: 45 pid: 5788 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224299.099011:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00100000:2.0:1782224299.099055:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+45:2346:x1868797312047360:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782224299.099078:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224299.099087:0:8291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165398 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517c2 expref: 45 pid: 5788 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.099104:0:8291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165398 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517c2 expref: 45 pid: 5788 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.099154:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165398 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517c2 expref: 45 pid: 5788 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.099179:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:2.0:1782224299.099185:0:8291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1653c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.099198:0:8291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1653c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.099206:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1653c2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.099247:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224299.099344:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+44:2346:x1868797312047360:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 292us (4211us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224299.099365:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 64 00010000:00010000:3.0:1782224299.100413:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1653c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100437:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1653c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224299.100499:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1782224299.100504:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782224299.100531:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1653c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100547:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1653c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100559:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b1653b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100566:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b1653b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100573:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b1653b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100580:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224299.100585:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b1653b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100610:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b1653b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100624:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:3.0:1782224299.100627:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224299.100632:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b1653b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100637:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b1653b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100657:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b1653bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100662:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b1653bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100669:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b1653bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100674:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224299.100677:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b1653bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100683:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b1653bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100691:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96ea87df7300) 00010000:00010000:3.0:1782224299.100693:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224299.100697:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b1653bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100713:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b1653bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100769:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b1653ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517c9 expref: 44 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100785:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1653c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517c9 expref: 43 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.100794:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:3.0:1782224299.100796:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782224299.100799:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675c00, rc 0) 00000100:00100000:3.0:1782224299.100865:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+43:11405:x1868797312046976:12345-192.168.202.7@tcp:101:stat.0 Request processed in 16964us (17803us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224299.100874:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 156 00000100:00100000:1.0:1782224299.182724:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224299.186559:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312047616 00000100:00100000:2.0:1782224299.186584:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312047616 00000100:00100000:2.0:1782224299.186694:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 157 00000100:00100000:2.0:1782224299.186707:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+43:11411:x1868797312047616:12345-192.168.202.7@tcp:36:truncate.0 00010000:00010000:2.0:1782224299.186793:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224299.186831:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1653c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517c9 expref: 43 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.186864:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:2.0:1782224299.186870:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224299.187223:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1653c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.187240:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1653c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.187251:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1653c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782224299.187312:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1782224299.187339:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aa37fede reply state 00000000513629d6 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1653c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224299.187349:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782224299.187595:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+45:11411:x1868797312047616:12345-192.168.202.7@tcp:36:truncate.0 Request processed in 889us (4883us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1782224299.187604:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 157 00000020:00080000:2.0:1782224299.187627:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782224299.191011:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1653c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.191054:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1653c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.191063:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1653c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.191070:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224299.191076:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1653c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.191084:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1653c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.191109:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:2.0:1782224299.191113:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224299.191119:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1653c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.191126:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1653c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224299.311414:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224299.311737:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312047744 00000100:00100000:2.0:1782224299.311752:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312047744 00000100:00100000:2.0:1782224299.311842:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 158 00000100:00100000:2.0:1782224299.311855:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+44:11425:x1868797312047744:12345-192.168.202.7@tcp:101:stat.0 00010000:00010000:2.0:1782224299.311890:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224299.311917:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1653d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a517d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312095:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b1653d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312112:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b1653d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312128:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b1653d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312144:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b1653de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312152:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b1653de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312159:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b1653de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312290:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b1653e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312300:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b1653e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312308:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b1653e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224299.312354:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1782224299.312360:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224299.312387:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b1653e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312414:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b1653e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312440:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b1653d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312447:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b1653d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312454:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b1653d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312461:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaba00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224299.312466:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b1653d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312473:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b1653d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312486:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:2.0:1782224299.312490:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224299.312494:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b1653d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312500:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b1653d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312529:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b1653de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312535:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b1653de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312547:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b1653de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312552:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224299.312556:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b1653de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312563:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b1653de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312572:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96ea8635fc00) 00010000:00010000:2.0:1782224299.312574:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224299.312577:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b1653de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312583:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b1653de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312622:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1653d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517d0 expref: 46 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312637:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b1653e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517d0 expref: 45 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.312645:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:2.0:1782224299.312648:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782224299.312650:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaae00, rc 0) 00000100:00100000:2.0:1782224299.312736:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+45:11425:x1868797312047744:12345-192.168.202.7@tcp:101:stat.0 Request processed in 883us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224299.312752:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 158 00000100:00100000:3.0:1782224299.463537:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224299.463737:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312048000 00000100:00100000:2.0:1782224299.463761:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312048000 00000100:00100000:2.0:1782224299.463848:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 159 00000100:00100000:2.0:1782224299.463860:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+45:11435:x1868797312048000:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1782224299.463889:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224299.463914:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1653ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a517d7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224299.464130:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1782224299.464307:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1653ec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517d7 expref: 47 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.464324:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96eaa7d65200) 00010000:00010000:2.0:1782224299.464328:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782224299.464334:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1653ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517d7 expref: 47 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.464350:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaa800, rc 0) 00000100:00100000:2.0:1782224299.464442:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+46:11435:x1868797312048000:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 583us (919us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1782224299.464450:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 159 00000100:00100000:1.0:1782224299.471216:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224299.471439:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312048256 00000100:00100000:3.0:1782224299.471454:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312048256 00000100:00100000:3.0:1782224299.471531:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 44 00000100:00100000:3.0:1782224299.471544:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea9c44c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+46:11435:x1868797312048256:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1782224299.473661:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea9c44c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+47:11435:x1868797312048256:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 2104us (2445us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1782224299.473681:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 44 00000100:00100000:1.0:1782224299.556886:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224299.557066:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312048512 00000100:00100000:2.0:1782224299.557081:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312048512 00000100:00100000:2.0:1782224299.557359:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 160 00000100:00100000:2.0:1782224299.557373:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+47:11441:x1868797312048512:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:2.0:1782224299.557442:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224299.557477:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1653fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a517de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.557637:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b165401 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.557655:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b1653e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517d0 expref: 48 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.557665:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b165401 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.557716:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b1653e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517d0 expref: 48 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.557735:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b1653e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517d0 expref: 48 pid: 5788 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224299.557754:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86107100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333023360:192.168.202.7@tcp:104: 00000100:00100000:2.0:1782224299.557917:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabf41cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1782224299.561962:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224299.562411:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312048640 00000100:00100000:3.0:1782224299.562436:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312048640 00010000:00010000:3.0:1782224299.562494:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b1653e5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517d0 expref: 49 pid: 5788 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224299.562577:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 65 00000100:00100000:3.0:1782224299.562589:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+49:2346:x1868797312048640:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224299.562611:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224299.562619:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b1653e5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517d0 expref: 49 pid: 5788 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.562634:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b1653e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517d0 expref: 49 pid: 5788 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.562663:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:3.0:1782224299.562669:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b165401 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.562680:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b165401 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.562688:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b165401 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.562710:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224299.562960:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+49:2346:x1868797312048640:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 372us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224299.562967:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 65 00010000:00010000:2.0:1782224299.564066:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b1653e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517d0 expref: 48 pid: 5788 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224299.564097:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86107100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333023360:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224299.564126:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b165401 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.564157:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b165401 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.564164:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b165401 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224299.564191:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1782224299.564407:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1653fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517de expref: 49 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.564436:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b165401 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517de expref: 48 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.564446:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:2.0:1782224299.564449:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782224299.564453:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab600, rc 0) 00000100:00100000:2.0:1782224299.564738:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+48:11441:x1868797312048512:12345-192.168.202.7@tcp:101:bash.0 Request processed in 7367us (7870us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1782224299.564750:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 160 00000100:00100000:1.0:1782224299.568838:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224299.569079:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312048896 00000100:00100000:0.0:1782224299.569093:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312048896 00000100:00100000:0.0:1782224299.569182:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 161 00000100:00100000:0.0:1782224299.569197:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+48:11441:x1868797312048896:12345-192.168.202.7@tcp:36:bash.0 00010000:00010000:0.0:1782224299.569622:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b16540f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.569648:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b16540f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.569665:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b16540f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782224299.569739:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1782224299.570306:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031322cfb reply state 000000001546f816 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b16540f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224299.570320:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782224299.570475:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+51:11441:x1868797312048896:12345-192.168.202.7@tcp:36:bash.0 Request processed in 1278us (1650us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1782224299.570484:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 161 00000020:00080000:0.0:1782224299.570491:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782224299.574061:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b16540f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.574087:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b16540f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.574117:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b16540f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.574124:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224299.574130:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b16540f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.574196:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b16540f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.574279:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:3.0:1782224299.574283:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224299.574289:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b16540f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.574296:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b16540f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224299.580276:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224299.580881:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312049024 00000100:00100000:3.0:1782224299.580896:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312049024 00000100:00100000:3.0:1782224299.581001:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 162 00000100:00100000:3.0:1782224299.581012:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+50:11441:x1868797312049024:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:3.0:1782224299.581083:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224299.581110:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165416 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a517e5 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.581246:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16541d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.581265:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b165401 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517de expref: 51 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.581298:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16541d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.581346:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b165401 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517de expref: 51 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.581360:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b165401 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517de expref: 51 pid: 5788 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224299.581377:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc88d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1868797333023488:192.168.202.7@tcp:104: 00000100:00100000:3.0:1782224299.581493:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabfca1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782224299.587408:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc88d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1868797333023488:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224299.587466:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16541d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224299.593992:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224299.594679:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312049152 00000100:00100000:0.0:1782224299.594695:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312049152 00010000:00010000:0.0:1782224299.594766:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b165401 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517de expref: 52 pid: 5788 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224299.594826:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 66 00000100:00100000:0.0:1782224299.594858:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:2349:x1868797312049152:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224299.594881:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224299.594890:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b165401 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517de expref: 52 pid: 5788 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.594905:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b165401 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517de expref: 52 pid: 5788 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.594933:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b165401 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517de expref: 52 pid: 5788 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.594957:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:0.0:1782224299.594962:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16541d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.594973:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16541d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.594982:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16541d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.595058:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224299.595146:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+51:2349:x1868797312049152:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 290us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224299.595155:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 66 00010000:00010000:1.0:1782224299.595822:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16541d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224299.595834:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16541d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224299.595900:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1782224299.595906:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782224299.595933:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16541d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224299.595978:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165416 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517e5 expref: 51 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224299.596004:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16541d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517e5 expref: 50 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224299.596012:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:1.0:1782224299.596072:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782224299.596075:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674e00, rc 0) 00000100:00100000:1.0:1782224299.596146:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+50:11441:x1868797312049024:12345-192.168.202.7@tcp:101:bash.0 Request processed in 15124us (15874us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224299.596157:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 162 00000100:00100000:1.0:1782224299.600530:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224299.600616:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312049408 00000100:00100000:3.0:1782224299.600631:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312049408 00000100:00100000:3.0:1782224299.600710:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:3.0:1782224299.600722:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+50:11441:x1868797312049408:12345-192.168.202.7@tcp:35:bash.0 00000100:00100000:3.0:1782224299.601090:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+51:11441:x1868797312049408:12345-192.168.202.7@tcp:35:bash.0 Request processed in 369us (575us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1782224299.601099:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 45 00000040:00080000:3.0:1782224299.732511:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782224299.732526:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782224299.732768:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1782224299.732793:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1782224299.735669:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782224299.740260:0:6608:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1782224299.740304:0:6608:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:0.0:1782224299.742702:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224299.742800:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312049664 00000100:00100000:2.0:1782224299.742815:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312049664 00000100:00100000:2.0:1782224299.742881:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 163 00000100:00100000:2.0:1782224299.742894:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+51:11451:x1868797312049664:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1782224299.742927:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224299.742956:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165424 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a517ec expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224299.743345:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1782224299.743522:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165424 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517ec expref: 53 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.743540:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96eaa7d65200) 00010000:00010000:3.0:1782224299.743543:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782224299.743549:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165424 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517ec expref: 53 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.743567:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaae00, rc 0) 00000100:00100000:3.0:1782224299.743651:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:11451:x1868797312049664:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 758us (961us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1782224299.743660:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 163 00000100:00100000:1.0:1782224299.748701:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224299.748849:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312049792 00000100:00100000:2.0:1782224299.748862:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312049792 00000100:00100000:2.0:1782224299.748951:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 164 00000100:00100000:2.0:1782224299.748963:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:11451:x1868797312049792:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:2.0:1782224299.749093:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b165432 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749123:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b165432 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749138:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b165432 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749156:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b165439 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749164:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b165439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749171:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b165439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749315:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b165440 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749324:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b165440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749332:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b165440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782224299.749410:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b165440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749437:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b165432 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749445:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b165432 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749452:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b165432 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749459:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaba00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224299.749464:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b165432 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749472:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b165432 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749492:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:2.0:1782224299.749494:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224299.749500:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b165432 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749506:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b165432 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749520:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b165439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749526:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b165439 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749539:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b165439 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749544:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbabc00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224299.749547:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b165439 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749554:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b165439 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749563:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96ea8635fc00) 00010000:00010000:2.0:1782224299.749565:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224299.749568:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b165439 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749574:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b165439 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749591:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b165440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749597:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b165440 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749603:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b165440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749608:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224299.749611:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b165440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749628:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b165440 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749636:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:2.0:1782224299.749638:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224299.749641:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b165440 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224299.749646:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b165440 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224299.749728:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:11451:x1868797312049792:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 767us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224299.749736:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 164 00000100:00100000:1.0:1782224299.755351:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224299.755473:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312050048 00000100:00100000:3.0:1782224299.755488:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312050048 00000100:00100000:3.0:1782224299.755640:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00100000:3.0:1782224299.755652:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:11451:x1868797312050048:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1782224299.756068:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+53:11451:x1868797312050048:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 418us (732us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1782224299.756076:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00100000:0.0:1782224299.808496:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224299.808875:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312050304 00000100:00100000:3.0:1782224299.808888:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312050304 00000100:00100000:3.0:1782224299.808966:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 165 00000100:00100000:3.0:1782224299.808977:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+53:11454:x1868797312050304:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1782224299.809009:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224299.809079:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165447 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a517f3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.809431:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16544e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.809449:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16544e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.809463:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16544e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.809479:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165455 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.809485:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.809491:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.809667:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16545c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.809678:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16545c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224299.809686:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16545c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224299.809699:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1782224299.814356:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16544e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.814398:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16544e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.814406:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16544e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.814425:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224299.814430:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16544e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.814440:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16544e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.814461:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:0.0:1782224299.814464:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224299.814469:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16544e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.814475:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16544e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.814500:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.814506:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165455 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.814512:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.814518:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224299.814528:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.814535:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165455 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.814543:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96ea87df7300) 00010000:00010000:0.0:1782224299.814546:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224299.814549:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165455 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.814555:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165455 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.816829:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b165447 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517f3 expref: 56 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.816875:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16545c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517f3 expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.816886:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:0.0:1782224299.816889:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782224299.816894:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674600, rc 0) 00000100:00100000:0.0:1782224299.817542:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:11454:x1868797312050304:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 8561us (9054us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1782224299.817554:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 165 00000100:00100000:1.0:1782224299.821359:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224299.821424:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224299.821471:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312050560 00000100:00100000:1.0:1782224299.821485:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312050560 00000100:00100000:1.0:1782224299.821564:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 166 00000100:00100000:1.0:1782224299.821578:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:11454:x1868797312050560:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:1.0:1782224299.821684:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16546a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224299.821706:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16546a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224299.821720:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16546a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224299.821763:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16546a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224299.821770:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16546a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224299.821796:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16546a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224299.821802:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224299.821807:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16546a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224299.821815:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16546a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224299.821830:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:1.0:1782224299.821833:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782224299.821839:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16546a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224299.821846:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16546a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224299.821930:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:11454:x1868797312050560:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 354us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224299.821939:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 166 00000100:00100000:0.0:1782224299.822227:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312050432 00000100:00100000:0.0:1782224299.822233:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312050432 00000100:00100000:0.0:1782224299.822275:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:0.0:1782224299.822283:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:2346:x1868797312050432:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224299.822304:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224299.822323:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16545c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517f3 expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224299.822338:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:0.0:1782224299.822342:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224299.828335:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:2346:x1868797312050432:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 6033us (6972us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224299.828355:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:1.0:1782224299.835241:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224299.835408:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312050816 00000100:00100000:0.0:1782224299.835432:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312050816 00000100:00100000:0.0:1782224299.835510:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00100000:0.0:1782224299.835522:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:11454:x1868797312050816:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:0.0:1782224299.835846:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:11454:x1868797312050816:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 325us (620us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1782224299.835855:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00100000:2.0:1782224300.095343:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224300.095477:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312051072 00000100:00100000:0.0:1782224300.095491:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312051072 00000100:00100000:0.0:1782224300.095574:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 167 00000100:00100000:0.0:1782224300.095587:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:11472:x1868797312051072:12345-192.168.202.7@tcp:101:cat.0 00010000:00010000:0.0:1782224300.095625:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224300.095653:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b165471 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a517fa expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224300.095874:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b165478 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224300.095916:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b165478 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224300.095996:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b165478 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224300.096262:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1782224300.096681:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b165471 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517fa expref: 58 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.096705:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b165478 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517fa expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.096714:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:1.0:1782224300.096726:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782224300.096731:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74a00, rc 0) 00000100:00100000:1.0:1782224300.096895:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:11472:x1868797312051072:12345-192.168.202.7@tcp:101:cat.0 Request processed in 1309us (1565us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1782224300.096905:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 167 00000100:00100000:1.0:1782224300.163841:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224300.164214:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312051200 00000100:00100000:2.0:1782224300.164232:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312051200 00000100:00100000:2.0:1782224300.164315:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 168 00000100:00100000:2.0:1782224300.164328:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:11473:x1868797312051200:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1782224300.164361:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224300.164391:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b165486 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51801 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.164512:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16548d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.164532:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16548d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.164572:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16548d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224300.164665:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1782224300.164669:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224300.164698:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16548d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.164731:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b165486 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51801 expref: 59 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.164766:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16548d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51801 expref: 58 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.164776:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:2.0:1782224300.164779:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782224300.164783:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaba00, rc 0) 00000100:00100000:2.0:1782224300.164877:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+58:11473:x1868797312051200:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 551us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224300.164885:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 168 00000100:00100000:3.0:1782224300.172494:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224300.173233:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312051584 00000100:00100000:0.0:1782224300.173249:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312051584 00000100:00100000:0.0:1782224300.173391:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:0.0:1782224300.173405:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+58:11473:x1868797312051584:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:0.0:1782224300.173973:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+59:11473:x1868797312051584:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 568us (1492us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1782224300.173985:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:2.0:1782224300.178659:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224300.178774:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312051712 00000100:00100000:3.0:1782224300.178788:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312051712 00000100:00100000:3.0:1782224300.178895:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:3.0:1782224300.178910:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc551c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+59:11473:x1868797312051712:12345-192.168.202.7@tcp:103:lfs.0 00010000:00010000:3.0:1782224300.178945:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782224300.178980:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16541d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517e5 expref: 59 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224300.179078:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b165478 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517fa expref: 58 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224300.179093:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b165328 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a517a6 expref: 57 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224300.179103:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96eaa7d65d00) 00010000:00010000:3.0:1782224300.179116:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224300.179183:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc551c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+56:11473:x1868797312051712:12345-192.168.202.7@tcp:103:lfs.0 Request processed in 276us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224300.179192:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:1.0:1782224300.182897:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224300.183089:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312051840 00000100:00100000:3.0:1782224300.183102:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312051840 00000100:00100000:3.0:1782224300.183172:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 169 00000100:00100000:3.0:1782224300.183186:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+56:11473:x1868797312051840:12345-192.168.202.7@tcp:58:lfs.0 00010000:00010000:3.0:1782224300.183388:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165494 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224300.183420:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165494 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224300.183437:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165494 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782224300.183749:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1782224300.183884:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+56:11473:x1868797312051840:12345-192.168.202.7@tcp:58:lfs.0 Request processed in 698us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224300.183894:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 169 00000100:00100000:3.0:1782224300.215951:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224300.216159:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312051968 00000100:00100000:2.0:1782224300.216174:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312051968 00000100:00100000:2.0:1782224300.216265:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 170 00000100:00100000:2.0:1782224300.216279:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+56:11475:x1868797312051968:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1782224300.216310:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224300.216339:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b16549b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51808 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.216490:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1654a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.216511:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1654a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.216526:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1654a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.216543:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1654a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.216551:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1654a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.216559:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1654a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.216709:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1654b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.216720:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1654b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.216727:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1654b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224300.216781:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1782224300.216787:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224300.216812:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1654b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.216838:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1654b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.216848:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1654a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.216856:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1654a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.216864:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1654a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.216870:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224300.216875:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1654a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.216883:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1654a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.216898:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:2.0:1782224300.216901:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224300.216906:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1654a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.216913:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1654a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.217387:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1654a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.217397:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1654a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.217424:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1654a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.217429:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaac00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224300.217433:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1654a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.217440:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1654a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.217450:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96ea8635fc00) 00010000:00010000:2.0:1782224300.217452:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224300.217455:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1654a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.217460:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1654a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.217507:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b16549b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51808 expref: 58 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.217523:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1654b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51808 expref: 57 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.217531:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea87df7100) 00010000:00010000:2.0:1782224300.217533:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782224300.217536:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab200, rc 0) 00000100:00100000:2.0:1782224300.217632:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:11475:x1868797312051968:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1355us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224300.217652:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 170 00000040:00080000:2.0:1782224300.757044:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782224300.757054:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782224300.757113:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1782224300.757119:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782224300.757238:0:11523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc553100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11523:1868797333023616:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782224300.762728:0:11523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabf41c3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1782224300.766825:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224300.795868:0:11523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc553100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11523:1868797333023616:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782224300.799277:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224300.799359:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312052096 00000100:00100000:0.0:1782224300.799370:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312052096 00000100:00100000:0.0:1782224300.799444:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 171 00000100:00100000:0.0:1782224300.799455:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:11486:x1868797312052096:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782224300.799491:0:5786:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782224300.799874:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:11486:x1868797312052096:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 420us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224300.799882:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 171 00000100:00100000:3.0:1782224300.817830:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224300.818320:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312052224 00000100:00100000:1.0:1782224300.818330:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312052224 00000100:00100000:1.0:1782224300.818386:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 172 00000100:00100000:1.0:1782224300.818398:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:11486:x1868797312052224:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1782224300.818483:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654b7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.818502:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.818516:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821127:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821153:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821166:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821203:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1654c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821226:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1654c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821234:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1654c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224300.821283:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1782224300.821288:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782224300.821303:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1654c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821316:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821324:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654b7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821332:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821338:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224300.821343:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821351:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654b7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821365:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96ea87df7c00) 00010000:00010000:1.0:1782224300.821369:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224300.821373:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821389:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821419:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821427:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654be lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821433:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821438:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224300.821441:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821447:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654be lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821455:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff96ea8508fd00) 00010000:00010000:1.0:1782224300.821458:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224300.821461:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654be lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821467:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821487:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1654c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821493:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1654c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821505:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1654c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821510:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224300.821514:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1654c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821520:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1654c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821528:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea87df7100) 00010000:00010000:1.0:1782224300.821530:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224300.821533:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1654c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.821540:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1654c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224300.821653:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:11486:x1868797312052224:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 Request processed in 3253us (3827us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224300.821667:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 172 00000100:00100000:2.0:1782224300.826502:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224300.829967:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312052480 00000100:00100000:1.0:1782224300.829980:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312052480 00000100:00100000:0.0:1782224300.834055:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 173 00000100:00100000:0.0:1782224300.834076:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:11486:x1868797312052480:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782224300.834101:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224300.834135:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b1654cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5180f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224300.834251:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b1654d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224300.834267:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b1654d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224300.834279:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b1654d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224300.834291:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1782224300.834389:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b1654d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224300.834397:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b1654d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224300.834414:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b1654d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224300.834421:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224300.834426:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b1654d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224300.834435:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b1654d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224300.834448:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea87df7100) 00010000:00010000:0.0:1782224300.834451:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782224300.834456:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b1654d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224300.834473:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b1654d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224300.834515:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b1654cc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5180f expref: 59 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224300.836354:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96ea87df7c00) 00010000:00010000:0.0:1782224300.836364:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782224300.836375:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b1654cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5180f expref: 59 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224300.836395:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74800, rc 0) 00000100:00100000:0.0:1782224300.836490:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+58:11486:x1868797312052480:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 2420us (9993us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1782224300.836499:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 173 00000100:00100000:0.0:1782224300.849397:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224300.849455:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312052608 00000100:00100000:0.0:1782224300.849465:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312052608 00000100:00100000:0.0:1782224300.849519:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 174 00000100:00100000:0.0:1782224300.849667:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+58:11486:x1868797312052608:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782224300.849705:0:5788:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782224300.849817:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+58:11486:x1868797312052608:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 289us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224300.849824:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 174 00000100:00100000:2.0:1782224300.864087:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224300.864124:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312052864 00000100:00100000:2.0:1782224300.864135:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312052864 00000100:00100000:2.0:1782224300.864198:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 175 00000100:00100000:2.0:1782224300.864209:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+58:11486:x1868797312052864:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782224300.864232:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224300.864235:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782224300.864265:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16548d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51801 expref: 58 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.864283:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:2.0:1782224300.864288:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224300.864301:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1654e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51816 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782224300.864767:0:5786:0:(osp_object.c:1673:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1782224300.864982:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1654e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.865008:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1654e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.865041:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1654e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.865099:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1654e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51816 expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.865115:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1654e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51816 expref: 59 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.865123:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:2.0:1782224300.865126:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782224300.865129:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaac00, rc 0) 00000100:00100000:2.0:1782224300.865195:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+59:11486:x1868797312052864:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 988us (1115us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1782224300.865202:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 175 00000100:00100000:2.0:1782224300.882746:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224300.883068:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312053120 00000100:00100000:1.0:1782224300.883078:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312053120 00000100:00100000:1.0:1782224300.883132:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 176 00000100:00100000:1.0:1782224300.883141:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+59:11486:x1868797312053120:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782224300.883217:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224300.883245:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1654e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51816 expref: 59 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.883269:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:1.0:1782224300.883279:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782224300.883299:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.883312:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.883321:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.886884:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd8fa73a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.886909:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd8fa73a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.886922:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd8fa73a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.887659:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.887671:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654f6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.887679:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.887684:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224300.887689:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.887709:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.887723:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:1.0:1782224300.887726:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224300.887732:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654f6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.887738:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b1654f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.887750:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd8fa73a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.887758:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd8fa73a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.887765:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd8fa73a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.887770:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224300.887773:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd8fa73a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.887778:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd8fa73a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.887783:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd8fa73a0 (ffff96ea8508fd00) 00010000:00010000:1.0:1782224300.887786:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224300.887788:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd8fa73a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224300.887804:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55200/0xcfd8b3ae4b1654fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd8fa73a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224300.887918:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+58:11486:x1868797312053120:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 4773us (5176us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782224300.887929:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 176 00000100:00100000:1.0:1782224300.890715:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224300.897127:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312053248 00000100:00100000:2.0:1782224300.897143:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312053248 00000100:00100000:2.0:1782224300.897662:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 177 00000100:00100000:2.0:1782224300.897673:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+58:11486:x1868797312053248:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782224300.897695:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224300.897721:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b165504 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5181d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.897778:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16550b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.897792:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16550b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.897804:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16550b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.897901:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b165504 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5181d expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.897920:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16550b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5181d expref: 59 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224300.897928:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96ea8635f000) 00010000:00010000:2.0:1782224300.897932:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782224300.897935:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaba00, rc 0) 00000100:00100000:2.0:1782224300.902752:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+59:11486:x1868797312053248:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 5064us (12027us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224300.902766:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 177 00000100:00100000:1.0:1782224300.924437:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224300.929783:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312053504 00000100:00100000:0.0:1782224300.929798:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312053504 00000100:00100000:0.0:1782224300.929893:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 178 00000100:00100000:0.0:1782224300.929905:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+59:11486:x1868797312053504:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782224300.929996:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165512 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224300.930042:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224300.930055:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782224300.930661:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1782224300.930673:0:6605:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381710657048ns, next at 382710654174ns, rc = 0 00000004:00010000:0.0:1782224300.930985:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fa9db5fb reply state 00000000f04be371 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224300.930997:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782224300.931149:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+61:11486:x1868797312053504:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 1243us (6718us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1782224300.931296:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 178 00010000:00010000:3.0:1782224300.941642:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224300.941662:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165512 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224300.941670:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165512 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224300.941677:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224300.941682:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165512 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224300.941689:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165512 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224300.941707:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96ea8635f000) 00010000:00010000:3.0:1782224300.941710:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782224300.941715:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165512 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224300.941721:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b165512 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224300.943717:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224300.943907:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312053632 00000100:00100000:3.0:1782224300.943917:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312053632 00000100:00100000:3.0:1782224300.943971:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 179 00000100:00100000:3.0:1782224300.943980:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+60:11486:x1868797312053632:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782224300.944004:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224300.944039:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b165519 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51824 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224300.944092:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b165519 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51824 expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224300.944105:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b165519 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51824 expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224300.944123:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96ea8635f000) 00010000:00010000:3.0:1782224300.944126:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782224300.944129:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674e00, rc 0) 00000100:00100000:3.0:1782224300.944333:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+61:11486:x1868797312053632:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 352us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224300.944340:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 179 00000100:00100000:0.0:1782224300.963414:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224300.963517:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312053760 00000100:00100000:1.0:1782224300.963538:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312053760 00000100:00100000:1.0:1782224300.963612:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 50 00000100:00100000:1.0:1782224300.963623:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797312053760:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1782224300.963984:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2347:x1868797312053760:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 362us (588us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1782224300.963993:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 50 00000100:00080000:0.0:1782224300.964841:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782224300.972465:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224300.972637:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312054016 00000100:00100000:3.0:1782224300.972649:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312054016 00000100:00100000:3.0:1782224300.972709:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:3.0:1782224300.972720:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+61:11486:x1868797312054016:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782224300.972971:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+62:11486:x1868797312054016:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 252us (514us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1782224300.973005:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:1.0:1782224300.976623:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224300.976722:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312054272 00000100:00100000:0.0:1782224300.976733:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312054272 00000100:00100000:0.0:1782224300.976825:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 180 00000100:00100000:0.0:1782224300.976836:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+62:11486:x1868797312054272:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782224300.976954:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+62:11486:x1868797312054272:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 120us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224300.976962:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 180 00000100:00100000:0.0:1782224301.000731:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224301.000847:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312054400 00000100:00100000:2.0:1782224301.000858:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312054400 00000100:00100000:2.0:1782224301.000968:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 181 00000100:00100000:2.0:1782224301.000980:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+62:11486:x1868797312054400:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782224301.001090:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224301.001114:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b165520 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5182b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.001213:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b165527 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.001237:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b165527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.001250:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b165527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224301.001295:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224301.001327:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b165527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.001366:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b165520 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5182b expref: 64 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.001385:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b165527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5182b expref: 63 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.001395:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96ea8635f000) 00010000:00010000:2.0:1782224301.001397:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782224301.001410:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaa200, rc 0) 00000100:00100000:2.0:1782224301.001467:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+63:11486:x1868797312054400:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 489us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224301.001474:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 181 00000100:00080000:0.0:1782224301.002916:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224301.011229:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224301.011507:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312054528 00000100:00100000:1.0:1782224301.011519:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312054528 00000100:00100000:1.0:1782224301.011589:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:1.0:1782224301.011603:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312054528:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782224301.011622:0:6585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224301.011644:0:6585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b16552e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51832 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782224301.011673:0:6585:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a95ac, blocks: 0x1 00010000:00010000:1.0:1782224301.011708:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:1.0:1782224301.011715:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224301.011727:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b16552e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51832 expref: 8 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224301.011743:0:6585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b16552e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51832 expref: 8 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224301.011755:0:6585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d55400, rc 0) 00000100:00100000:1.0:1782224301.011870:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2346:x1868797312054528:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 272us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224301.011879:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:1.0:1782224301.018743:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224301.018901:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312054784 00000100:00100000:3.0:1782224301.018913:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312054784 00000100:00100000:3.0:1782224301.018972:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 182 00000100:00100000:3.0:1782224301.018982:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+63:11486:x1868797312054784:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782224301.019125:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+63:11486:x1868797312054784:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 142us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224301.019133:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 182 00000100:00100000:3.0:1782224301.023803:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224301.024663:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312054912 00000100:00100000:0.0:1782224301.024679:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312054912 00000100:00100000:0.0:1782224301.024740:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 52 00000100:00100000:0.0:1782224301.024750:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:11486:x1868797312054912:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782224301.024771:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224301.024789:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078d2cc6e/0xcfd8b3ae4b165535 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51839 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.024822:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b16552e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51832 expref: 9 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.024831:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224301.024835:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224301.024841:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078d2cc6e/0xcfd8b3ae4b165535 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51839 expref: 9 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.024875:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b16552e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51832 expref: 9 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.024889:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b16552e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51832 expref: 9 pid: 6585 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224301.024903:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfc4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6582:1868797333023744:192.168.202.7@tcp:104: 00000100:00100000:0.0:1782224301.025006:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782224301.027966:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfc4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6582:1868797333023744:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224301.028036:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078d2cc6e/0xcfd8b3ae4b165535 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51839 expref: 9 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.028059:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74200, rc 0) 00000100:00100000:3.0:1782224301.028118:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:11486:x1868797312054912:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 3368us (4331us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224301.028126:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 52 00000100:00100000:0.0:1782224301.029633:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224301.029765:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312055040 00000100:00100000:3.0:1782224301.029774:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312055040 00010000:00010000:3.0:1782224301.029812:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b16552e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51832 expref: 9 pid: 6585 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224301.029855:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 67 00000100:00100000:3.0:1782224301.029865:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:2346:x1868797312055040:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224301.029890:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224301.029913:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b16552e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51832 expref: 9 pid: 6585 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.029928:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b16552e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51832 expref: 9 pid: 6585 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.029952:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b16552e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51832 expref: 9 pid: 6585 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.029968:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782224301.029972:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782224301.029979:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078d2cc6e/0xcfd8b3ae4b165535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51839 expref: 8 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.029989:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078d2cc6e/0xcfd8b3ae4b165535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51839 expref: 8 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.030068:0:5771:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000078d2cc6e/0xcfd8b3ae4b165535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51839 expref: 8 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224301.030084:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcb8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5771:1868797333023872:192.168.202.7@tcp:105: 00000100:00100000:3.0:1782224301.032795:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea81668600 going to sleep for 11 seconds 00000100:00100000:3.0:1782224301.033803:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcb8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5771:1868797333023872:192.168.202.7@tcp:105: 00010000:00010000:3.0:1782224301.033831:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224301.034681:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2346:x1868797312055040:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 4811us (5049us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224301.034694:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 67 00000100:00100000:0.0:1782224301.042113:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224301.047089:0:11906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312055168 00000100:00100000:3.0:1782224301.047105:0:11906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312055168 00002000:00100000:3.0:1782224301.047172:0:11906:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff96ea83360000 x1868797312055168/t0(0) o4->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:2/0 lens 504/0 e 0 to 0 dl 1782224312 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782224301.047183:0:11906:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96ea83360000 with x1868797312055168 ext(0->8) 00002000:00010000:3.0:1782224301.047189:0:11906:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96ea83360000 00000100:00100000:3.0:1782224301.047227:0:11906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:3.0:1782224301.047238:0:11906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2347:x1868797312055168:12345-192.168.202.7@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1782224301.048341:0:11906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+10:2347:x1868797312055168:12345-192.168.202.7@tcp:4:lhsmtool_posix.0 Request processed in 1071us (6205us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1782224301.048642:0:11906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 4 00002000:00100000:3.0:1782224301.048651:0:11906:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff96ea83360000 x1868797312055168/t4294967314(0) o4->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:2/0 lens 504/448 e 0 to 0 dl 1782224312 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782224301.048660:0:11906:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96ea83360000 with x1868797312055168 ext(0->8) 00002000:00010000:3.0:1782224301.048665:0:11906:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96ea83360000 00000100:00100000:2.0:1782224301.074562:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224301.074677:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312055296 00000100:00100000:3.0:1782224301.074687:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312055296 00000100:00100000:3.0:1782224301.074742:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 183 00000100:00100000:3.0:1782224301.074752:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+63:11486:x1868797312055296:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1782224301.150204:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1782224301.150219:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:1.0:1782224301.150301:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1782224301.150340:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1782224301.150357:0:5808:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96eaa7a0fb40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1782224301.150362:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff96eabf61d600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96eaa7a0f300 00000020:00080000:1.0:1782224301.150365:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff96eabf61d800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96ea85291400 00000020:00080000:1.0:1782224301.150501:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1782224301.150674:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1782224301.150685:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782224301.150707:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333024000:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782224301.152224:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:11486:x1868797312055296:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 Request processed in 77465us (77662us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224301.152237:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 183 00000100:00100000:3.0:1782224301.152281:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782224301.152368:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333024128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1782224301.155278:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224301.157101:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333024000 00000100:00100000:0.0:1782224301.157116:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333024000 00000100:00100000:0.0:1782224301.157186:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782224301.157197:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333024000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782224301.157230:0:6584:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1782224301.157265:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a3a95a9, atime: 0x6a3a95a9, ctime: 0x6a3a95a9, blocks: 0xb 00010000:00010000:0.0:1782224301.157274:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b16553c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.157363:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=381s v=(0 0) 00010000:00010000:0.0:1782224301.157369:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224301.157374:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b16553c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.157393:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b16553c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.157412:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b16553c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.157421:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b16553c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.157440:0:6584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1782224301.157881:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782224301.160488:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1868797333024000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3285us (5207us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1782224301.160513:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:0.0:1782224301.160555:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224301.160563:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b16553c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.160575:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75000 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224301.160579:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b16553c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.160589:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b16553c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.160608:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b16553c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.160615:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b16553c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.160635:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224301.160637:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224301.160639:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224301.160984:0:3304:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1782224301.160992:0:3304:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1782224301.161030:0:3304:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff96eabf234700 x1868797333024000/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782224317 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1782224301.161043:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96eabf234700/2, rc 0, transno 4294967307 00000100:00100000:1.0:1782224301.161049:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333024000:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782224301.161170:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224301.161210:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224301.161242:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312055424 00000100:00100000:3.0:1782224301.161248:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312055424 00000100:00100000:0.0:1782224301.161843:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333024128 00000100:00100000:0.0:1782224301.161849:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333024128 00000100:00080000:1.0:1782224301.161882:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782224301.161900:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 54 00000100:00100000:0.0:1782224301.161909:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+10:2346:x1868797312055424:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1782224301.161990:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782224301.162004:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333024128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1782224301.162223:0:6584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1782224301.162227:0:6584:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782224300 00002000:00010000:0.0:1782224301.162229:0:6584:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1782224301.162232:0:6584:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1782224300 -> 1782224300 00002000:00010000:0.0:1782224301.162234:0:6584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:3.0:1782224301.162427:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96eaa7a0ad80/2, rc 0, transno 4294967315 00000100:00100000:3.0:1782224301.162435:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333024128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1782224301.162974:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1868797333024128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 281us (1073us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1782224301.162983:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000040:00080000:3.0:1782224301.204454:0:12300:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782224301.204464:0:12300:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782224301.204509:0:12300:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1782224301.204516:0:12300:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1782224301.261959:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1782224301.261979:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1782224301.262149:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312055424:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 Request processed in 100236us (100976us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224301.262161:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 54 00000100:00100000:3.0:1782224301.270144:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224301.270386:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312055680 00000100:00100000:1.0:1782224301.270396:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312055680 00000100:00100000:1.0:1782224301.270501:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 184 00000100:00100000:1.0:1782224301.270514:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:11486:x1868797312055680:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782224301.270571:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224301.270601:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b165527 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5182b expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224301.270619:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96ea8635f000) 00010000:00010000:1.0:1782224301.270624:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782224301.270662:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b165543 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224301.270678:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b165543 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224301.270688:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b165543 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782224301.270962:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063ef2ed7 reply state 00000000291c553b transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b165543 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224301.270979:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782224301.271730:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+19:11486:x1868797312055680:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 1216us (1629us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1782224301.271739:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 184 00000100:00100000:0.0:1782224301.277376:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224301.277421:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312055808 00000100:00100000:0.0:1782224301.277431:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312055808 00010000:00010000:3.0:1782224301.277722:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b165543 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.277736:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b165543 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.277744:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b165543 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.277751:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224301.277756:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b165543 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.277765:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b165543 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.277783:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96ea8635f000) 00010000:00010000:3.0:1782224301.277786:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224301.277801:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b165543 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.277809:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b165543 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224301.278120:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 56 00000100:00100000:0.0:1782224301.278132:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312055808:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782224301.278335:0:6582:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1782224301.278339:0:6582:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1782224300 -> 1782224299 00002000:00010000:0.0:1782224301.278342:0:6582:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1782224297 00002000:00010000:0.0:1782224301.278344:0:6582:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1782224300 -> 1782224299 00002000:00010000:0.0:1782224301.278346:0:6582:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1782224301.278417:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2346:x1868797312055808:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 286us (1051us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1782224301.278424:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 56 00000100:00100000:1.0:1782224301.289595:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224301.289695:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312056064 00000100:00100000:3.0:1782224301.289706:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312056064 00000100:00100000:3.0:1782224301.289869:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 185 00000100:00100000:3.0:1782224301.289881:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:11486:x1868797312056064:12345-192.168.202.7@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1782224301.289970:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16554a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.289988:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16550b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5181d expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.289997:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16554a lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224301.295908:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16550b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5181d expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224301.295977:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16550b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5181d expref: 18 pid: 5786 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224301.295991:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e986bbe680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1868797333024256:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224301.296107:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc8b6180 going to sleep for 11 seconds 00000100:00100000:2.0:1782224301.300112:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e986bbe680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1868797333024256:192.168.202.7@tcp:104: 00000100:00100000:3.0:1782224301.300136:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:2.0:1782224301.300153:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16554a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224301.300544:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312056192 00000100:00100000:0.0:1782224301.300574:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312056192 00010000:00010000:0.0:1782224301.300827:0:8291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16550b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5181d expref: 19 pid: 5786 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224301.300899:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 68 00000100:00100000:0.0:1782224301.300910:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8757e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+19:2347:x1868797312056192:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224301.300944:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224301.300958:0:8291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16550b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5181d expref: 19 pid: 5786 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.300970:0:8291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16550b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5181d expref: 19 pid: 5786 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.300994:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b16550b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5181d expref: 19 pid: 5786 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.301010:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96ea8635f000) 00010000:00010000:0.0:1782224301.301043:0:8291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16554a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.301053:0:8291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16554a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.301062:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16554a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.301085:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224301.301130:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8757e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:2347:x1868797312056192:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 223us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224301.301146:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 68 00010000:00010000:3.0:1782224301.301499:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16554a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.301509:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16554a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.301543:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16554a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.301551:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16554a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.301568:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16554a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.301575:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224301.301579:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16554a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.301587:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16554a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.301596:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96ea8635f000) 00010000:00010000:3.0:1782224301.301600:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1782224301.301604:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16554a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.301610:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b16554a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224301.301690:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+17:11486:x1868797312056064:12345-192.168.202.7@tcp:55:lhsmtool_posix.0 Request processed in 11811us (12104us total) trans 0 rc -22/-22 00000100:00100000:3.0:1782224301.301698:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 185 00000100:00100000:0.0:1782224301.318536:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224301.318733:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312056320 00000100:00100000:2.0:1782224301.318743:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312056320 00000100:00100000:2.0:1782224301.318804:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 57 00000100:00100000:2.0:1782224301.318814:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2346:x1868797312056320:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1782224301.318866:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b165551 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.318888:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078d2cc6e/0xcfd8b3ae4b165535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51839 expref: 8 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.318898:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1782224301.318902:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782224301.318907:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b165551 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.318952:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078d2cc6e/0xcfd8b3ae4b165535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51839 expref: 8 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.318966:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078d2cc6e/0xcfd8b3ae4b165535 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51839 expref: 8 pid: 6582 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224301.318994:0:6584:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6584:1868797333024384:192.168.202.7@tcp:104: 00000100:00100000:2.0:1782224301.319091:0:6584:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabf41c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224301.325483:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224301.325518:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312056448 00000100:00100000:0.0:1782224301.325533:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312056448 00010000:00010000:0.0:1782224301.325575:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078d2cc6e/0xcfd8b3ae4b165535 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51839 expref: 9 pid: 6582 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224301.325615:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:0.0:1782224301.325626:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:2346:x1868797312056448:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224301.325642:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224301.325669:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078d2cc6e/0xcfd8b3ae4b165535 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51839 expref: 9 pid: 6582 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.325684:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078d2cc6e/0xcfd8b3ae4b165535 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51839 expref: 9 pid: 6582 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.325717:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782224301.325722:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782224301.325742:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b165551 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.325752:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b165551 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.325774:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224301.325836:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:2346:x1868797312056448:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 210us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224301.325845:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 69 00010000:00010000:3.0:1782224301.326351:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078d2cc6e/0xcfd8b3ae4b165535 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51839 expref: 8 pid: 6582 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224301.326366:0:6584:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6584:1868797333024384:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224301.326390:0:6584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b165551 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.326424:0:6584:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b165551 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.326431:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b165551 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.326457:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b165551 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.326465:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b165551 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.326472:0:6584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b165551 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.326478:0:6584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab000 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224301.326482:0:6584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b165551 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.326489:0:6584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b165551 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.326501:0:6584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b165551 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.326520:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010e92e7e/0xcfd8b3ae4b165551 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224301.326574:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312056320:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 Request processed in 7761us (8046us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224301.326582:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 57 00000100:00100000:0.0:1782224301.329803:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224301.329932:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312056704 00000100:00100000:3.0:1782224301.329944:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312056704 00000100:00100000:3.0:1782224301.330010:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 186 00000100:00100000:3.0:1782224301.330047:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+17:11486:x1868797312056704:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1782224301.330130:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165558 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.330148:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165558 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.330161:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165558 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.330370:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16555f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.330382:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b165519 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51824 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.330389:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16555f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.330452:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b165519 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51824 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.330467:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b165519 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51824 expref: 18 pid: 5786 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224301.330483:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcbbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1868797333024512:192.168.202.7@tcp:104: 00000100:00100000:3.0:1782224301.330560:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc8b6780 going to sleep for 11 seconds 00000100:00100000:0.0:1782224301.334099:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224301.334131:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312056832 00000100:00100000:0.0:1782224301.334140:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312056832 00010000:00010000:0.0:1782224301.334181:0:8291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b165519 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51824 expref: 19 pid: 5786 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224301.334227:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 70 00000100:00100000:0.0:1782224301.334237:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+19:2347:x1868797312056832:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224301.334251:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224301.334258:0:8291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b165519 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51824 expref: 19 pid: 5786 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.334269:0:8291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b165519 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51824 expref: 19 pid: 5786 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.334290:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96ea8635f000) 00010000:00010000:0.0:1782224301.334296:0:8291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16555f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.334306:0:8291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16555f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.334314:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16555f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.334351:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224301.334412:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+19:2347:x1868797312056832:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 176us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224301.334419:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 70 00010000:00010000:3.0:1782224301.335492:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b165519 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51824 expref: 18 pid: 5786 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224301.335517:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcbbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1868797333024512:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224301.335537:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16555f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.335545:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16555f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.335551:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16555f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782224301.335785:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1782224301.336085:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1782224301.336133:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1782224301.336233:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcbbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6605:1868797333024640:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782224301.336307:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224301.336339:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc8b6480 going to sleep for 11 seconds 00000100:00100000:0.0:1782224301.336554:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333024640 00000100:00100000:0.0:1782224301.336562:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333024640 00000100:00100000:0.0:1782224301.336625:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782224301.336634:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6605:x1868797333024640:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782224301.336906:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6605:x1868797333024640:12345-0@lo:1000:mdt00_003.0 Request processed in 272us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224301.336982:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782224301.337298:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcbbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6605:1868797333024640:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1782224301.342349:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1782224301.343169:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eac1d8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6605:1868797333024768:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782224301.343243:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224301.343327:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea889aaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782224301.344891:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333024768 00000100:00100000:2.0:1782224301.344904:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333024768 00000100:00100000:3.0:1782224301.345417:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782224301.345428:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6605:x1868797333024768:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782224301.345827:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6605:x1868797333024768:12345-0@lo:1000:mdt00_003.0 Request processed in 400us (2582us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1782224301.345835:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782224301.346277:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eac1d8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6605:1868797333024768:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1782224301.346323:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16555f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.346334:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16555f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.346341:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16555f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.346348:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224301.346352:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16555f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.346373:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16555f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.346390:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96ea8635f000) 00010000:00010000:0.0:1782224301.346393:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782224301.346431:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16555f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.346438:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16555f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.346474:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165494 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.346480:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165494 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.346486:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165494 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.346491:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224301.346494:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165494 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.346499:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165494 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.346508:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea87df7100) 00010000:00010000:0.0:1782224301.346510:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782224301.346513:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165494 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.346529:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165494 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.346552:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165566 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.346567:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1654b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51808 expref: 21 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.346576:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165566 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.346610:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1654b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51808 expref: 21 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.346625:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1654b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51808 expref: 21 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224301.346638:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfc4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1868797333024896:192.168.202.7@tcp:104: 00000100:00100000:0.0:1782224301.350556:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea889aaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1782224301.350704:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224301.350805:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfc4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1868797333024896:192.168.202.7@tcp:104: 00010000:00010000:0.0:1782224301.350832:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165566 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224301.351513:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312056960 00000100:00100000:3.0:1782224301.351522:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312056960 00010000:00010000:3.0:1782224301.351556:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1654b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51808 expref: 22 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224301.351633:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 71 00000100:00100000:3.0:1782224301.351643:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+22:2346:x1868797312056960:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224301.351659:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224301.351667:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1654b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51808 expref: 22 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.351681:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1654b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51808 expref: 22 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.351707:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b1654b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51808 expref: 22 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.351723:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea87df7100) 00010000:00010000:3.0:1782224301.351739:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165566 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.351759:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165566 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.351766:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165566 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.351797:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224301.351853:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+21:2346:x1868797312056960:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 211us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224301.351861:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 71 00010000:00010000:2.0:1782224301.351908:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165566 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.351928:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165566 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.351942:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165566 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.351949:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165566 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.351956:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165566 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.351963:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224301.351968:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165566 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.351976:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165566 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.351985:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea87df7100) 00010000:00010000:2.0:1782224301.351988:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224301.351992:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165566 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.352003:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165566 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.352065:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165558 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.352071:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165558 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.352077:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165558 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.352082:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224301.352085:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165558 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.352091:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165558 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.352099:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea87df7100) 00010000:00010000:2.0:1782224301.352102:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782224301.352105:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165558 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224301.352110:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165558 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782224301.352383:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782224301.352388:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782224301.352925:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1782224301.352934:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782224301.353036:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+20:11486:x1868797312056704:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 22969us (23219us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1782224301.353046:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 186 00000020:00080000:2.0:1782224301.353051:0:6605:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1782224301.357239:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224301.357324:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312057216 00000100:00100000:3.0:1782224301.357335:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312057216 00000100:00100000:3.0:1782224301.357601:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 50 00000100:00100000:3.0:1782224301.357613:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea9c44e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+20:11486:x1868797312057216:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782224301.358375:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782224301.358499:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1782224301.358550:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16556d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.358568:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16556d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.358578:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16556d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.358586:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16556d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.358592:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16556d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.358604:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16556d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224301.358627:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782224301.358724:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea9c44e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+22:11486:x1868797312057216:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 1111us (1493us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1782224301.358732:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 50 00000020:00080000:3.0:1782224301.358737:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782224301.358922:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224301.358930:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16556d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.358944:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224301.358949:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16556d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.358957:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16556d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.358970:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96ea87df7b00) 00010000:00010000:0.0:1782224301.358973:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782224301.358978:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16556d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.358984:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b16556d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224301.359004:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224301.359006:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224301.359008:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224301.780243:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224302.165605:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782224302.165629:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333025024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782224302.165706:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224302.166171:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333025024 00000100:00100000:3.0:1782224302.166179:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333025024 00000100:00100000:3.0:1782224302.166247:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782224302.166257:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1868797333025024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782224302.166298:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224302.166358:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1868797333025024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224302.166366:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782224302.166745:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333025024:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782224302.807226:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224303.188236:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797333025152:0@lo:400:kworker.0 00000100:00100000:2.0:1782224303.188327:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224303.188605:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797333025280:0@lo:400:kworker.0 00000100:00100000:1.0:1782224303.188642:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224303.188669:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782224303.188675:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333025408:0@lo:400:kworker.0 00000100:00100000:1.0:1782224303.188698:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224303.188733:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e9879d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333025536:0@lo:400:kworker.0 00000100:00100000:1.0:1782224303.188762:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224303.188794:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333025536 00000100:00100000:1.0:1782224303.188801:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333025536 00000100:00100000:1.0:1782224303.188856:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782224303.188866:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1868797333025536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224303.188928:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1868797333025536:12345-0@lo:400:kworker.0 Request processed in 64us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224303.188943:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1782224303.188967:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782224303.189000:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333025536:0@lo:400:kworker.0 00000100:00100000:1.0:1782224303.189064:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333025280 00000100:00100000:1.0:1782224303.189068:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333025280 00000100:00100000:1.0:1782224303.189091:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333025408 00000100:00100000:1.0:1782224303.189094:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333025408 00000100:00100000:1.0:1782224303.189113:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1782224303.189119:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797333025280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224303.189152:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797333025280:12345-0@lo:400:kworker.0 Request processed in 33us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224303.189158:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1782224303.189168:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1782224303.189174:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333025408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224303.189201:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333025408:12345-0@lo:400:kworker.0 Request processed in 27us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224303.189207:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:1.0:1782224303.189227:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224303.189242:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333025408:0@lo:400:kworker.0 00000100:00100000:1.0:1782224303.189252:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797333025280:0@lo:400:kworker.0 00000100:00100000:1.0:1782224303.189302:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333025152 00000100:00100000:1.0:1782224303.189305:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333025152 00000100:00100000:1.0:1782224303.189330:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1782224303.189336:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797333025152:12345-0@lo:400:kworker.0 00000040:00080000:3.0:1782224303.190753:0:12351:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782224303.190762:0:12351:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782224303.190815:0:12351:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1782224303.190821:0:12351:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782224303.198957:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797333025152:12345-0@lo:400:kworker.0 Request processed in 9611us (10620us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224303.198984:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1782224303.199134:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782224303.199151:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf7fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333025792:0@lo:400:kworker.0 00000100:00100000:1.0:1782224303.199212:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224303.200213:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333025792 00000100:00100000:0.0:1782224303.200226:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333025792 00000100:00100000:0.0:1782224303.200290:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782224303.200320:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1868797333025792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224303.200417:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1868797333025792:12345-0@lo:400:kworker.0 Request processed in 118us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224303.200425:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782224303.201393:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf7fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333025792:0@lo:400:kworker.0 00000100:00080000:1.0:1782224303.202355:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782224303.202752:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e9879d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797333025152:0@lo:400:kworker.0 00000100:00100000:2.0:1782224303.202783:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf7fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333025664:0@lo:400:kworker.0 00000100:00100000:2.0:1782224303.202849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224303.203295:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333025664 00000100:00100000:1.0:1782224303.203302:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333025664 00000100:00080000:0.0:1782224303.203998:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224303.204098:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782224303.204113:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797333025664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224303.204213:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797333025664:12345-0@lo:400:kworker.0 Request processed in 105us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224303.204220:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1782224303.204852:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf7fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333025664:0@lo:400:kworker.0 00000100:00100000:0.0:1782224303.371626:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224303.371704:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312057472 00000100:00100000:3.0:1782224303.371715:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312057472 00000100:00100000:3.0:1782224303.371810:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 187 00000100:00100000:3.0:1782224303.371823:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+22:11504:x1868797312057472:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1782224303.371857:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224303.371883:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165574 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51840 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.372509:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16557b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.372528:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16557b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.372541:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16557b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224303.372553:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1782224303.372741:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165574 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51840 expref: 25 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.372763:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16557b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51840 expref: 24 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.372773:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:3.0:1782224303.372776:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782224303.372780:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674e00, rc 0) 00000100:00100000:3.0:1782224303.372847:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+24:11504:x1868797312057472:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1027us (1228us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1782224303.372855:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 187 00000100:00080000:0.0:1782224303.373256:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224303.381674:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224303.385432:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312057600 00000100:00100000:2.0:1782224303.385450:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312057600 00000100:00100000:2.0:1782224303.385521:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 188 00000100:00100000:2.0:1782224303.385533:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+24:11504:x1868797312057600:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:2.0:1782224303.385613:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165589 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.385632:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165589 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.385644:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165589 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.385658:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165590 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.385672:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.385679:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.385972:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b165597 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.385982:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b165597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.385989:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b165597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782224303.386055:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b165597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386068:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165589 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386074:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165589 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386081:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165589 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386087:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbabe00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224303.386090:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165589 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386097:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165589 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386117:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:2.0:1782224303.386121:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224303.386127:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165589 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386134:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b165589 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386145:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386152:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165590 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386158:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165590 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386163:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224303.386166:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165590 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386172:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165590 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386180:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96ea8635f700) 00010000:00010000:2.0:1782224303.386182:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224303.386185:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165590 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386191:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab800/0xcfd8b3ae4b165590 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386217:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b165597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386224:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b165597 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386229:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b165597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386235:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224303.386237:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b165597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386243:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b165597 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386250:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8635fe00) 00010000:00010000:2.0:1782224303.386252:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224303.386255:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b165597 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224303.386260:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab200/0xcfd8b3ae4b165597 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224303.386352:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+24:11504:x1868797312057600:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 819us (4685us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224303.386360:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 188 00000100:00100000:1.0:1782224303.455335:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224303.455375:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312057856 00000100:00100000:1.0:1782224303.455396:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312057856 00000100:00100000:1.0:1782224303.455451:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 189 00000100:00100000:1.0:1782224303.455462:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+24:11507:x1868797312057856:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1782224303.455485:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224303.455507:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b16559e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51847 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.455587:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.455603:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.455615:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.455640:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.455648:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.455654:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.455991:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1655b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.456000:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1655b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.456007:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1655b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224303.456039:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1782224303.456132:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.456140:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.456147:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.456153:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224303.456157:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.456174:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.456186:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:1.0:1782224303.456189:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224303.456194:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.456201:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.456215:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.456220:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.456225:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.456230:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55000 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224303.456233:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.456239:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.456246:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96ea8508fa00) 00010000:00010000:1.0:1782224303.456248:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224303.456250:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.456265:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.456306:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b16559e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51847 expref: 27 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.456318:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1655b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51847 expref: 26 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.456325:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8508f300) 00010000:00010000:1.0:1782224303.456327:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782224303.456329:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d54000, rc 0) 00000100:00100000:1.0:1782224303.456451:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+26:11507:x1868797312057856:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 991us (1126us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1782224303.456459:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 189 00000100:00100000:2.0:1782224303.463767:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224303.463818:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312057984 00000100:00100000:1.0:1782224303.463829:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312057984 00000100:00100000:1.0:1782224303.463898:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 190 00000100:00100000:1.0:1782224303.463910:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+26:11507:x1868797312057984:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:1.0:1782224303.463992:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1655c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.464010:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1655c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.464046:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1655c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.464090:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1655c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.464099:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1655c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.464106:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1655c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.464123:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224303.464129:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1655c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.464137:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1655c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.464150:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8508f300) 00010000:00010000:1.0:1782224303.464154:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782224303.464159:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1655c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.464164:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1655c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224303.464240:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+26:11507:x1868797312057984:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 332us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224303.464248:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 190 00000100:00100000:0.0:1782224303.471350:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224303.471463:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312058240 00000100:00100000:3.0:1782224303.471474:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312058240 00000100:00100000:3.0:1782224303.471537:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:3.0:1782224303.471549:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+26:11507:x1868797312058240:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1782224303.471843:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+27:11507:x1868797312058240:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 295us (501us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1782224303.471851:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:0.0:1782224303.510975:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224303.511142:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312058496 00000100:00100000:1.0:1782224303.511155:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312058496 00000100:00100000:1.0:1782224303.511225:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 191 00000100:00100000:1.0:1782224303.511249:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+27:11032:x1868797312058496:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1782224303.511276:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224303.511298:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1655c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5184e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.511429:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.511446:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1655b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51847 expref: 28 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.511456:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655cf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.511491:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1655b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51847 expref: 28 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.511504:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1655b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51847 expref: 28 pid: 5786 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224303.511519:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf7fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1868797333025920:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224303.511617:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabfbcd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782224303.517143:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224303.517270:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf7fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1868797333025920:192.168.202.7@tcp:104: 00010000:00010000:1.0:1782224303.517298:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224303.517418:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312058624 00000100:00100000:0.0:1782224303.517426:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312058624 00010000:00010000:0.0:1782224303.517471:0:8291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1655b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51847 expref: 29 pid: 5786 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224303.517510:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 72 00000100:00100000:0.0:1782224303.517520:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc898e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+29:2347:x1868797312058624:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224303.517534:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224303.517541:0:8291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1655b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51847 expref: 29 pid: 5786 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.517554:0:8291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1655b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51847 expref: 29 pid: 5786 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.517580:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1655b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51847 expref: 29 pid: 5786 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.517611:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8508f300) 00010000:00010000:0.0:1782224303.517617:0:8291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.517628:0:8291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.517653:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655cf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.517686:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782224303.517801:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.517810:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224303.517830:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1782224303.518007:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1655c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5184e expref: 30 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.518048:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5184e expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.518056:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8508f300) 00010000:00010000:3.0:1782224303.518059:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782224303.518062:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d55000, rc 0) 00000100:00100000:0.0:1782224303.518125:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc898e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+29:2347:x1868797312058624:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 606us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224303.518134:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 72 00000100:00100000:3.0:1782224303.520841:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+28:11032:x1868797312058496:12345-192.168.202.7@tcp:101:bash.0 Request processed in 9577us (9860us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1782224303.520856:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 191 00000100:00100000:0.0:1782224303.527364:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224303.527475:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312058880 00000100:00100000:1.0:1782224303.527488:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312058880 00000100:00100000:1.0:1782224303.527567:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 192 00000100:00100000:1.0:1782224303.527578:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+28:11032:x1868797312058880:12345-192.168.202.7@tcp:36:bash.0 00010000:00010000:1.0:1782224303.527868:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.527885:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.527897:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782224303.527950:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1782224303.527976:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001279a45e reply state 000000008fbdc802 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224303.527986:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1782224303.528076:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1782224303.528186:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+32:11032:x1868797312058880:12345-192.168.202.7@tcp:36:bash.0 Request processed in 607us (831us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1782224303.528194:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 192 00000020:00080000:1.0:1782224303.528199:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1782224303.534695:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:3.0:1782224303.537460:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.537481:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.537515:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.537522:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224303.537527:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.537536:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.537560:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8508f300) 00010000:00010000:3.0:1782224303.537563:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224303.537568:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.537574:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54e00/0xcfd8b3ae4b1655dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224303.537685:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312059008 00000100:00100000:1.0:1782224303.537697:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312059008 00000100:00100000:1.0:1782224303.537772:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 193 00000100:00100000:1.0:1782224303.537783:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+31:11032:x1868797312059008:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1782224303.537809:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224303.537828:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1655e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51855 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.537894:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1655e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51855 expref: 32 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.537917:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1655e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51855 expref: 32 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.537938:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8508f300) 00010000:00010000:1.0:1782224303.537941:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782224303.537944:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d55a00, rc 0) 00000100:00100000:1.0:1782224303.538067:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+32:11032:x1868797312059008:12345-192.168.202.7@tcp:101:bash.0 Request processed in 285us (3384us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224303.538075:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 193 00000100:00100000:3.0:1782224303.544897:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224303.544978:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312059136 00000100:00100000:1.0:1782224303.544998:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312059136 00000100:00100000:1.0:1782224303.545125:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 58 00000100:00100000:1.0:1782224303.545136:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:11032:x1868797312059136:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1782224303.545157:0:6585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224303.545182:0:6585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054d63481/0xcfd8b3ae4b1655eb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5185c expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782224303.545213:0:6585:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a3a95ab, atime: 0x6a3a95a9, ctime: 0x6a3a95ab, blocks: 0xb 00010000:00010000:1.0:1782224303.545237:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=384s v=(0 0) 00010000:00010000:1.0:1782224303.545242:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224303.545252:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054d63481/0xcfd8b3ae4b1655eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5185c expref: 8 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.545269:0:6585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000054d63481/0xcfd8b3ae4b1655eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5185c expref: 8 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.545304:0:6585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d55e00, rc 0) 00000100:00100000:1.0:1782224303.545369:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:11032:x1868797312059136:12345-192.168.202.7@tcp:101:bash.0 Request processed in 235us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224303.545408:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 58 00000100:00080000:0.0:1782224303.546121:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782224303.549784:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224303.549989:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312059264 00000100:00100000:2.0:1782224303.550052:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312059264 00002000:00010000:2.0:1782224303.550098:0:6588:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1782224303.550103:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96eabfc4ed80 with x1868797312059264 ext(0->18446744073709551615) 00002000:00010000:2.0:1782224303.550115:0:6588:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96eabfc4ed80. 00000100:00100000:2.0:1782224303.550148:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:2.0:1782224303.550158:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2348:x1868797312059264:12345-192.168.202.7@tcp:10:bash.0 00002000:00010000:2.0:1782224303.550452:0:6588:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1782224303.550456:0:6588:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1782224299 -> 1782224303 00002000:00010000:2.0:1782224303.550458:0:6588:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1782224297 -> 1782224297 00002000:00010000:2.0:1782224303.550461:0:6588:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1782224299 -> 1782224303 00002000:00010000:2.0:1782224303.550463:0:6588:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1782224303.550530:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:2348:x1868797312059264:12345-192.168.202.7@tcp:10:bash.0 Request processed in 372us (754us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1782224303.550538:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 5 00002000:00010000:2.0:1782224303.550542:0:6588:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1782224303.550544:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96eabfc4ed80 with x1868797312059264 ext(0->18446744073709551615) 00002000:00010000:2.0:1782224303.550549:0:6588:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96eabfc4ed80. 00000100:00100000:2.0:1782224303.632530:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224303.632588:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224303.632620:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224303.632883:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312059520 00000100:00100000:3.0:1782224303.632903:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312059520 00000100:00100000:3.0:1782224303.632982:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 93 00000100:00100000:3.0:1782224303.632991:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2348:x1868797312059520:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224303.633108:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2348:x1868797312059520:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 118us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224303.633114:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 93 00000100:00080000:2.0:1782224303.633191:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782224303.634319:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312059648 00000100:00100000:0.0:1782224303.634332:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312059648 00000100:00100000:0.0:1782224303.634427:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 160 00000100:00100000:0.0:1782224303.634448:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2348:x1868797312059648:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224303.634536:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2348:x1868797312059648:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 99us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224303.634544:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 160 00000100:00080000:2.0:1782224303.634561:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224303.634711:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312059392 00000100:00100000:1.0:1782224303.634717:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312059392 00000100:00100000:1.0:1782224303.634757:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 297 00000100:00100000:1.0:1782224303.634765:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2348:x1868797312059392:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224303.634792:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2348:x1868797312059392:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 29us (2280us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224303.634798:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 297 00000100:00100000:2.0:1782224303.703207:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224303.703238:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333026048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782224303.703324:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224303.703486:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333026048 00000100:00100000:3.0:1782224303.703494:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333026048 00000100:00100000:3.0:1782224303.703561:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782224303.703586:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1868797333026048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782224303.703636:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224303.703689:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1868797333026048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224303.703696:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782224303.704032:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333026048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782224303.729771:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224303.729921:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312059776 00000100:00100000:1.0:1782224303.729933:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312059776 00000100:00100000:1.0:1782224303.729999:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 194 00000100:00100000:1.0:1782224303.730011:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+32:11521:x1868797312059776:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:1.0:1782224303.730144:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1655f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730166:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1655f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730179:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1655f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730193:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1655f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730213:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1655f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730220:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1655f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730534:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165600 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730544:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730552:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782224303.730604:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730618:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1655f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730625:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1655f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730633:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1655f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730639:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224303.730644:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1655f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730652:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1655f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730674:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:1.0:1782224303.730677:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224303.730682:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1655f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730689:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1655f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730702:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1655f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730708:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1655f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730714:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1655f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730719:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224303.730722:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1655f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730729:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1655f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730736:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96ea8508fc00) 00010000:00010000:1.0:1782224303.730739:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224303.730741:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1655f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730747:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b1655f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730774:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730781:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165600 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730786:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165600 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730792:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224303.730795:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165600 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730801:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165600 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730808:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8508f300) 00010000:00010000:1.0:1782224303.730811:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224303.730814:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165600 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.730820:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165600 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224303.730897:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+32:11521:x1868797312059776:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 887us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224303.730905:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 194 00000100:00100000:3.0:1782224303.809585:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224303.810219:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312060032 00000100:00100000:0.0:1782224303.810234:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312060032 00000100:00100000:0.0:1782224303.810313:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 195 00000100:00100000:0.0:1782224303.810328:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+32:11524:x1868797312060032:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1782224303.810351:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224303.810386:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b165607 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51863 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.810473:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b16560e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.810502:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b16560e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.810514:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b16560e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.810529:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165615 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.810536:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.810543:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.810868:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b16561c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.810877:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b16561c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.810884:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b16561c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224303.810892:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1782224303.810980:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b16560e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.810987:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b16560e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.810995:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b16560e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.811007:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75000 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224303.811011:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b16560e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.813209:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b16560e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.813231:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:0.0:1782224303.813234:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224303.813249:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b16560e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.813258:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75000/0xcfd8b3ae4b16560e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.813281:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.813289:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165615 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.813295:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165615 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.813301:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224303.813304:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165615 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.813310:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165615 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.813339:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96eaa7d65b00) 00010000:00010000:0.0:1782224303.813342:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224303.813345:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165615 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.813350:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165615 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.813433:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b165607 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51863 expref: 35 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.813449:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b16561c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51863 expref: 34 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224303.813457:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8508f300) 00010000:00010000:0.0:1782224303.813460:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782224303.813463:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a75200, rc 0) 00000100:00100000:0.0:1782224303.813611:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+34:11524:x1868797312060032:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 3287us (4043us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1782224303.813621:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 195 00000100:00100000:0.0:1782224303.824551:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224303.824788:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312060160 00000100:00100000:3.0:1782224303.824799:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312060160 00000100:00100000:3.0:1782224303.824861:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 196 00000100:00100000:3.0:1782224303.824872:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+34:11524:x1868797312060160:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:3.0:1782224303.824950:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16562a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.824969:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5184e expref: 34 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.824978:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16562a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.825011:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5184e expref: 34 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.825061:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5184e expref: 34 pid: 5786 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224303.825089:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eac1d8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1868797333026176:192.168.202.7@tcp:104: 00000100:00100000:3.0:1782224303.825194:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea889aa840 going to sleep for 11 seconds 00000100:00100000:2.0:1782224303.828369:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:0.0:1782224303.828494:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224303.828567:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312060416 00000100:00100000:1.0:1782224303.828580:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312060416 00000100:00100000:1.0:1782224303.828649:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 52 00000100:00100000:1.0:1782224303.828675:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8327a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+35:5563:x1868797312060416:12345-192.168.202.7@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1782224303.829177:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8327a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+36:5563:x1868797312060416:12345-192.168.202.7@tcp:35:ldlm_bl.0 Request processed in 501us (823us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1782224303.829186:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 52 00000100:00100000:3.0:1782224303.829765:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eac1d8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1868797333026176:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224303.829804:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16562a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224303.832215:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224303.832672:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312060544 00000100:00100000:3.0:1782224303.832685:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312060544 00010000:00010000:3.0:1782224303.833171:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5184e expref: 36 pid: 5786 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224303.833231:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 73 00000100:00100000:3.0:1782224303.833244:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+36:2346:x1868797312060544:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224303.833265:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224303.833272:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5184e expref: 36 pid: 5786 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.833286:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5184e expref: 36 pid: 5786 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.833313:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55000/0xcfd8b3ae4b1655cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5184e expref: 36 pid: 5786 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.833333:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8508f300) 00010000:00010000:3.0:1782224303.833340:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16562a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.833352:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16562a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.833362:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16562a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.833441:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224303.833525:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+35:2346:x1868797312060544:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 283us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224303.833534:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 73 00010000:00010000:1.0:1782224303.834329:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16562a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.834343:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16562a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.834477:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16562a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.834486:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16562a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.834496:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16562a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.834503:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224303.834508:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16562a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.834516:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16562a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.834532:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8508f300) 00010000:00010000:1.0:1782224303.834535:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782224303.834540:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16562a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.834564:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b16562a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224303.834646:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+34:11524:x1868797312060160:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 9775us (10103us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224303.834657:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 196 00000100:00100000:0.0:1782224303.839245:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224303.840221:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312060800 00000100:00100000:2.0:1782224303.840236:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312060800 00000100:00100000:2.0:1782224303.840347:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:2.0:1782224303.840360:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+34:11524:x1868797312060800:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:2.0:1782224303.840717:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+35:11524:x1868797312060800:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 357us (1485us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1782224303.840726:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:0.0:1782224303.946295:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224303.946531:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312061056 00000100:00100000:3.0:1782224303.946545:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312061056 00000100:00100000:3.0:1782224303.946625:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 197 00000100:00100000:3.0:1782224303.946639:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+35:11535:x1868797312061056:12345-192.168.202.7@tcp:101:cat.0 00010000:00010000:3.0:1782224303.946677:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224303.946805:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165631 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5186a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.946920:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165638 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.946940:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.946955:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.946973:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16563f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.946980:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16563f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.946987:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16563f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.947975:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165646 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.947989:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.947998:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224303.948012:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1782224303.948357:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.948366:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165638 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.948385:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165638 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.948392:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224303.948397:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165638 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.948406:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165638 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.948421:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:3.0:1782224303.948425:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224303.948431:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165638 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.948451:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165638 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.948471:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16563f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.948478:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16563f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.948484:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16563f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.948489:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224303.948492:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16563f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.948499:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16563f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.948507:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96ea87df7400) 00010000:00010000:3.0:1782224303.948510:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224303.948513:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16563f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.948519:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675a00/0xcfd8b3ae4b16563f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.948577:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b165631 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5186a expref: 38 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.948598:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5186a expref: 37 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224303.948612:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8508f300) 00010000:00010000:3.0:1782224303.948615:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782224303.948618:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674600, rc 0) 00000100:00100000:3.0:1782224303.948828:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+37:11535:x1868797312061056:12345-192.168.202.7@tcp:101:cat.0 Request processed in 2191us (2547us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1782224303.948839:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 197 00000100:00100000:3.0:1782224303.955108:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224303.955198:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312061312 00000100:00100000:2.0:1782224303.955214:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312061312 00000100:00100000:2.0:1782224303.955287:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 54 00000100:00100000:2.0:1782224303.955298:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+37:11535:x1868797312061312:12345-192.168.202.7@tcp:35:cat.0 00000100:00100000:2.0:1782224303.955663:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+38:11535:x1868797312061312:12345-192.168.202.7@tcp:35:cat.0 Request processed in 365us (570us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1782224303.955673:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 54 00000100:00100000:0.0:1782224303.990745:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224303.990858:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312061568 00000100:00100000:1.0:1782224303.990871:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312061568 00000100:00100000:1.0:1782224303.990952:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 198 00000100:00100000:1.0:1782224303.990965:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+38:11536:x1868797312061568:12345-192.168.202.7@tcp:36:rm.0 00010000:00010000:1.0:1782224303.991161:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782224303.991197:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674600/0xcfd8b3ae4b165646 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5186a expref: 38 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.991227:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b16561c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51863 expref: 37 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.991243:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b1655e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51855 expref: 36 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.991256:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8508f300) 00010000:00010000:1.0:1782224303.991273:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782224303.991300:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165654 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.991317:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165654 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.991355:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165654 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.991385:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b16565b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.991393:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b16565b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.991401:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b16565b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.993556:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165662 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.993586:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165662 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.993601:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165662 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782224303.999788:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1782224303.999808:0:6605:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 384779792501ns, next at 385779788040ns, rc = 0 00010000:00010000:1.0:1782224303.999905:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165669 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.999928:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.999943:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.999965:0:6605:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165669 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.999972:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165669 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.999979:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165669 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224303.999998:0:6605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782224304.000071:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165662 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.000078:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165662 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.000083:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165662 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.000089:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224304.000094:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165662 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.000103:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165662 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.000118:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8508f200) 00010000:00010000:1.0:1782224304.000122:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782224304.000128:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165662 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.000145:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165662 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.000169:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165654 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.000175:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165654 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.000180:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165654 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.000184:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224304.000187:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165654 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.000193:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165654 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.000201:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:1.0:1782224304.000204:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224304.000206:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165654 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.000212:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165654 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782224304.000224:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000913287c0 reply state 0000000005562836 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b16565b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224304.000233:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782224304.000364:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+37:11536:x1868797312061568:12345-192.168.202.7@tcp:36:rm.0 Request processed in 9396us (9629us total) trans 4294967481 rc 0/0 00010000:00010000:0.0:1782224304.005267:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224304.005315:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165669 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.005331:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55800 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224304.005337:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165669 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.005347:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165669 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.005382:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96ea8508f200) 00010000:00010000:0.0:1782224304.005386:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782224304.005392:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165669 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.005399:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b165669 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.005442:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224304.005445:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224304.005447:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224304.005714:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 198 00010000:00010000:0.0:1782224304.007961:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b16565b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.007980:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b16565b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.007989:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b16565b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.007995:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224304.008000:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b16565b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.008060:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b16565b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.008082:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96ea8508fc00) 00010000:00010000:0.0:1782224304.008085:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224304.008090:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b16565b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.008096:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b16565b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224304.101757:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224304.102131:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312061824 00000100:00100000:1.0:1782224304.102149:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312061824 00000100:00100000:1.0:1782224304.102240:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 199 00000100:00100000:1.0:1782224304.102257:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+36:11542:x1868797312061824:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1782224304.102294:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224304.102321:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165670 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51871 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.102559:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165677 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.102580:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165677 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.102595:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165677 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.102612:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b16567e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.102619:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b16567e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.102625:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b16567e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782224304.104260:0:5787:0:(osp_object.c:1673:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1782224304.104521:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165685 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.104550:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.104564:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.104619:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165677 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.104627:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165677 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.104635:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165677 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.104642:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224304.104647:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165677 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.104656:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165677 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.104672:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:1.0:1782224304.104675:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224304.104680:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165677 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.104686:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b165677 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782224304.104709:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000c2a61aa reply state 00000000e38262ac transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b16567e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224304.104725:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782224304.104778:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165670 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51871 expref: 39 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.104795:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51871 expref: 38 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.104802:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96ea8508ff00) 00010000:00010000:1.0:1782224304.104805:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782224304.104807:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d54800, rc 0) 00000100:00100000:1.0:1782224304.104920:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+39:11542:x1868797312061824:12345-192.168.202.7@tcp:101:bash.0 Request processed in 2669us (3176us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1782224304.104928:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 199 00010000:00010000:2.0:1782224304.109916:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b16567e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.109936:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b16567e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.109943:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b16567e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.109949:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224304.109954:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b16567e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.109978:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b16567e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.109996:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96ea8508f300) 00010000:00010000:2.0:1782224304.109999:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224304.110003:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b16567e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.110010:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b16567e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224304.111618:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224304.111821:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312061952 00000100:00100000:1.0:1782224304.111832:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312061952 00000100:00100000:1.0:1782224304.111890:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 59 00000100:00100000:1.0:1782224304.111900:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2346:x1868797312061952:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1782224304.111919:0:6585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224304.111940:0:6585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165693 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51878 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782224304.111966:0:6585:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224304.111987:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=384s v=(0 0) 00010000:00010000:1.0:1782224304.111992:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224304.112001:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165693 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51878 expref: 6 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.112055:0:6585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165693 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51878 expref: 6 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.112069:0:6585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d55200, rc 0) 00000100:00100000:1.0:1782224304.112186:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2346:x1868797312061952:12345-192.168.202.7@tcp:101:bash.0 Request processed in 286us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224304.112193:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 59 00000100:00100000:3.0:1782224304.121292:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224304.121388:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312062080 00000100:00100000:0.0:1782224304.121399:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312062080 00000100:00100000:0.0:1782224304.121581:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 60 00000100:00100000:0.0:1782224304.121592:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:11542:x1868797312062080:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:0.0:1782224304.121611:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224304.121628:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b16569a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5187f expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.121661:0:6715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165693 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51878 expref: 7 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.121672:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224304.121676:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224304.121682:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b16569a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5187f expref: 7 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.121742:0:6715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165693 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51878 expref: 7 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.121757:0:6715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165693 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51878 expref: 7 pid: 6585 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224304.121772:0:6715:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf59d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6715:1868797333026304:192.168.202.7@tcp:104: 00000100:00100000:0.0:1782224304.121971:0:6715:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaaa254840 going to sleep for 11 seconds 00000100:00100000:2.0:1782224304.131153:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224304.132774:0:6715:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf59d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6715:1868797333026304:192.168.202.7@tcp:104: 00010000:00010000:0.0:1782224304.132812:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b16569a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5187f expref: 7 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.132836:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74600, rc 0) 00000100:00100000:1.0:1782224304.133602:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312062208 00000100:00100000:1.0:1782224304.133612:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312062208 00010000:00010000:1.0:1782224304.133655:0:8291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165693 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51878 expref: 8 pid: 6585 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224304.133783:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:11542:x1868797312062080:12345-192.168.202.7@tcp:101:bash.0 Request processed in 12192us (12501us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224304.133793:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 60 00000100:00100000:1.0:1782224304.134874:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 74 00000100:00100000:1.0:1782224304.134899:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83278a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2347:x1868797312062208:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782224304.134916:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224304.134940:0:8291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165693 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51878 expref: 7 pid: 6585 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.134957:0:8291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165693 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51878 expref: 7 pid: 6585 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.134988:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165693 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51878 expref: 7 pid: 6585 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.135044:0:8291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224304.135048:0:8291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224304.135057:0:8291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b16569a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5187f expref: 6 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.135171:0:8291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b16569a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5187f expref: 6 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.135213:0:8291:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b16569a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5187f expref: 6 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224304.135229:0:8291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf7fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8291:1868797333026432:192.168.202.7@tcp:105: 00000100:00100000:1.0:1782224304.135313:0:8291:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabfbcd300 going to sleep for 11 seconds 00000100:00100000:1.0:1782224304.142652:0:8291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf7fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8291:1868797333026432:192.168.202.7@tcp:105: 00010000:00010000:1.0:1782224304.142680:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224304.142754:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83278a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2347:x1868797312062208:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 7868us (11611us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224304.142766:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 74 00000100:00100000:2.0:1782224304.142916:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224304.143873:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312062464 00000100:00100000:0.0:1782224304.143883:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312062464 00000100:00100000:0.0:1782224304.143957:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 55 00000100:00100000:0.0:1782224304.143967:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+38:11542:x1868797312062464:12345-192.168.202.7@tcp:35:bash.0 00000100:00100000:0.0:1782224304.144941:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+39:11542:x1868797312062464:12345-192.168.202.7@tcp:35:bash.0 Request processed in 970us (2502us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1782224304.144952:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 55 00000100:00100000:2.0:1782224304.384585:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224304.384692:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312062592 00000100:00100000:3.0:1782224304.384786:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312062592 00000100:00100000:3.0:1782224304.385050:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 200 00000100:00100000:3.0:1782224304.385064:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8327b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+39:11559:x1868797312062592:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1782224304.385099:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224304.385124:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1656a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51886 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224304.385284:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b1656a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224304.385301:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b1656a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224304.385316:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b1656a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224304.385413:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1782224304.385417:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782224304.385472:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b1656a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224304.385506:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1656a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51886 expref: 41 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224304.385534:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b1656a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51886 expref: 40 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224304.385545:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:3.0:1782224304.385548:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782224304.385553:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674400, rc 0) 00000100:00100000:3.0:1782224304.385654:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8327b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+40:11559:x1868797312062592:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 592us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224304.385663:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 200 00000100:00100000:1.0:1782224304.391976:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224304.392979:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312062848 00000100:00100000:3.0:1782224304.392995:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312062848 00000100:00100000:2.0:1782224304.393602:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 201 00000100:00100000:2.0:1782224304.393617:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+40:11559:x1868797312062848:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1782224304.393645:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224304.393673:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1656af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5188d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.393819:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b1656b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.393837:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b1656b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.393851:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b1656b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224304.393964:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1782224304.394469:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b1656af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5188d expref: 43 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.394492:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b1656b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5188d expref: 42 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.394501:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96ea8508ff00) 00010000:00010000:2.0:1782224304.394504:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782224304.394508:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaae00, rc 0) 00000100:00100000:2.0:1782224304.394614:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+42:11559:x1868797312062848:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1000us (2654us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1782224304.394623:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 201 00000100:00100000:0.0:1782224304.400937:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224304.401051:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224304.401114:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312063232 00000100:00100000:3.0:1782224304.401127:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312063232 00000100:00100000:3.0:1782224304.401226:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:3.0:1782224304.401240:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8757f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+42:2348:x1868797312063232:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224304.401261:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224304.401297:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b1656b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5188d expref: 42 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224304.401323:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96ea8508ff00) 00010000:00010000:3.0:1782224304.401329:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224304.401418:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8757f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+41:2348:x1868797312063232:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 181us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224304.401443:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:1.0:1782224304.403810:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312063104 00000100:00100000:1.0:1782224304.403829:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312063104 00000100:00100000:1.0:1782224304.404056:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 202 00000100:00100000:1.0:1782224304.404072:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+41:11559:x1868797312063104:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1782224304.404106:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224304.404279:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51894 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.404434:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1656cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.404453:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1656cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.404469:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1656cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224304.404484:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1782224304.404656:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51894 expref: 44 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.404681:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1656cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51894 expref: 43 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.404692:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96ea8508ff00) 00010000:00010000:1.0:1782224304.404774:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782224304.404779:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d54a00, rc 0) 00000100:00100000:1.0:1782224304.404869:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+43:11559:x1868797312063104:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 801us (3816us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1782224304.404877:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 202 00000100:00100000:3.0:1782224304.415465:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224304.415555:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312063360 00000100:00100000:1.0:1782224304.415570:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312063360 00000100:00100000:1.0:1782224304.415645:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00100000:1.0:1782224304.415658:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+6:2346:x1868797312063360:12345-192.168.202.7@tcp:1:lfs.0 00010000:00010000:1.0:1782224304.415761:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b1656d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.415791:0:6585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b16569a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5187f expref: 6 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.415800:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782224304.415805:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782224304.415810:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b1656d9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.415856:0:6585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b16569a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5187f expref: 6 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.415874:0:6585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b16569a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5187f expref: 6 pid: 6715 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224304.415904:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf7fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6585:1868797333026560:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224304.416059:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabfbcd300 going to sleep for 11 seconds 00000100:00100000:1.0:1782224304.420553:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf7fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6585:1868797333026560:192.168.202.7@tcp:104: 00010000:00010000:1.0:1782224304.420597:0:6585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b1656d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224304.421519:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224304.421727:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312063488 00000100:00100000:1.0:1782224304.421739:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312063488 00002000:00100000:1.0:1782224304.421805:0:6589:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff96eac1d8e680 x1868797312063488/t0(0) o4->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:5/0 lens 504/0 e 0 to 0 dl 1782224315 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782224304.421834:0:6589:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96eac1d8e680 with x1868797312063488 ext(0->8) 00010000:00010000:1.0:1782224304.421846:0:6589:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b16569a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5187f expref: 7 pid: 6715 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.421866:0:6589:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b16569a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5187f expref: 7 pid: 6715 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782224304.421875:0:6589:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff96eac1d8e680 00000100:00100000:1.0:1782224304.421974:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:1.0:1782224304.421988:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312063488:12345-192.168.202.7@tcp:4:lfs.0 00000100:00100000:0.0:1782224304.424503:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:2346:x1868797312063488:12345-192.168.202.7@tcp:4:lfs.0 Request processed in 2500us (2972us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1782224304.424523:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 3 00002000:00100000:0.0:1782224304.424541:0:6589:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff96eac1d8e680 x1868797312063488/t4294967308(0) o4->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:5/0 lens 504/448 e 0 to 0 dl 1782224315 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782224304.424554:0:6589:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96eac1d8e680 with x1868797312063488 ext(0->8) 00010000:00010000:0.0:1782224304.424566:0:6589:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b16569a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5187f expref: 9 pid: 6715 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.424589:0:6589:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b16569a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5187f expref: 9 pid: 6715 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782224304.424599:0:6589:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff96eac1d8e680 00000100:00100000:0.0:1782224304.427816:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224304.428077:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312063616 00000100:00100000:2.0:1782224304.428089:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312063616 00010000:00010000:2.0:1782224304.428140:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b16569a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5187f expref: 9 pid: 6715 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224304.428306:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 75 00000100:00100000:2.0:1782224304.428318:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:2348:x1868797312063616:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782224304.428337:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1782224304.428363:0:5770:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1782224304.428366:0:5770:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782224303 00002000:00010000:2.0:1782224304.428379:0:5770:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1782224304 00002000:00010000:2.0:1782224304.428382:0:5770:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1782224303 00010000:00010000:2.0:1782224304.428389:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b16569a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5187f expref: 9 pid: 6715 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.428423:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b16569a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5187f expref: 9 pid: 6715 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.428456:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b16569a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5187f expref: 9 pid: 6715 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.428480:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782224304.428485:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782224304.428491:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b1656d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.428501:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b1656d9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.428547:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224304.428635:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2348:x1868797312063616:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 319us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224304.428644:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 75 00010000:00010000:3.0:1782224304.428836:0:6585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b1656d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224304.428848:0:6585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b1656d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224304.428891:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b1656d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224304.428902:0:6585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b1656d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224304.428911:0:6585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b1656d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224304.428920:0:6585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55200 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224304.428924:0:6585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b1656d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224304.428936:0:6585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b1656d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224304.428950:0:6585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b1656d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224304.428967:0:6585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b1656d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224304.429078:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312063360:12345-192.168.202.7@tcp:1:lfs.0 Request processed in 13422us (13630us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224304.429087:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00100000:3.0:1782224304.433304:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224304.433523:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312063872 00000100:00100000:1.0:1782224304.433536:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312063872 00000100:00100000:1.0:1782224304.433613:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 56 00000100:00100000:1.0:1782224304.433626:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea9c44d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+43:11559:x1868797312063872:12345-192.168.202.7@tcp:35:lfs.0 00000004:00010000:1.0:1782224304.433733:0:5789:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1656cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51894 expref: 43 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782224304.434071:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1782224304.434102:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1782224304.435250:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1782224304.435350:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.435388:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165685 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51871 expref: 47 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.435428:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656e0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.435481:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51871 expref: 47 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.435499:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165685 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51871 expref: 47 pid: 5787 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224304.435519:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf7fd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5789:1868797333026688:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224304.435710:0:5789:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabfbcd300 going to sleep for 11 seconds 00000100:00100000:2.0:1782224304.438871:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf7fd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5789:1868797333026688:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224304.438912:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224304.439791:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224304.439858:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312064000 00000100:00100000:0.0:1782224304.439869:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312064000 00010000:00010000:0.0:1782224304.439919:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165685 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51871 expref: 48 pid: 5787 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224304.439961:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 76 00000100:00100000:0.0:1782224304.439972:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+48:2346:x1868797312064000:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224304.439993:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224304.440001:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165685 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51871 expref: 48 pid: 5787 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.440076:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51871 expref: 48 pid: 5787 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.440105:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54800/0xcfd8b3ae4b165685 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51871 expref: 48 pid: 5787 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.440488:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96ea8508ff00) 00010000:00010000:0.0:1782224304.440495:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.440507:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.440517:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656e0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.440593:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224304.440674:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+47:2346:x1868797312064000:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 702us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224304.440685:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 76 00010000:00010000:2.0:1782224304.440788:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.440797:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782224304.440968:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1782224304.441516:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1782224304.441749:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1868797333026816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782224304.441821:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224304.442259:0:5789:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabf41cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782224304.442402:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333026816 00000100:00100000:3.0:1782224304.442411:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333026816 00000100:00100000:3.0:1782224304.442495:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782224304.442506:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5789:x1868797333026816:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1782224304.442620:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5789:x1868797333026816:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 115us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224304.442627:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782224304.442703:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1868797333026816:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1782224304.443261:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1782224304.443348:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf7fd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1868797333026944:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1782224304.443407:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224304.444084:0:5789:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabfbcd300 going to sleep for 11 seconds 00000100:00100000:2.0:1782224304.444408:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333026944 00000100:00100000:2.0:1782224304.444420:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333026944 00000100:00100000:2.0:1782224304.444477:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782224304.444488:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5789:x1868797333026944:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782224304.444848:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5789:x1868797333026944:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 360us (1440us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1782224304.444857:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782224304.444971:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf7fd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1868797333026944:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1782224304.445408:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1782224304.445467:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.445480:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.445488:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.445513:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224304.445519:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.445526:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.445653:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96ea8508ff00) 00010000:00010000:1.0:1782224304.445656:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1782224304.445661:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.445666:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782224304.445873:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1782224304.445989:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1782224304.446000:0:5789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 385225983937ns, next at 386225982073ns, rc = 0 00000001:00080000:1.0:1782224304.446005:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1782224304.446300:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96ea8508ff00) 00010000:00010000:1.0:1782224304.446304:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782224304.446313:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1656cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51894 expref: 51 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224304.446506:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea9c44d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+50:11559:x1868797312063872:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 12881us (13216us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1782224304.446520:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 56 00000020:00080000:1.0:1782224304.446525:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1782224304.449806:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224304.450148:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312064128 00000100:00100000:0.0:1782224304.450228:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312064128 00000100:00100000:0.0:1782224304.450335:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 203 00000100:00100000:0.0:1782224304.450348:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+50:11559:x1868797312064128:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1782224304.450393:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224304.450426:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b1656e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5189b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.450533:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b1656e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5189b expref: 51 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.450648:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b1656e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5189b expref: 51 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.450672:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:0.0:1782224304.450675:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782224304.450678:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74400, rc 0) 00000100:00100000:0.0:1782224304.450892:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+51:11559:x1868797312064128:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 536us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224304.450900:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 203 00000100:00100000:3.0:1782224304.457736:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224304.457819:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312064384 00000100:00100000:0.0:1782224304.457834:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312064384 00000100:00100000:0.0:1782224304.457980:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 57 00000100:00100000:0.0:1782224304.457993:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+51:11559:x1868797312064384:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:0.0:1782224304.458401:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:11559:x1868797312064384:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 409us (677us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1782224304.458413:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 57 00000100:00100000:3.0:1782224304.603172:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224304.603456:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312064512 00000100:00100000:1.0:1782224304.603469:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312064512 00000100:00100000:1.0:1782224304.603552:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 204 00000100:00100000:1.0:1782224304.603565:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:11569:x1868797312064512:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:1.0:1782224304.603675:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1656ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.603708:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1656ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.603723:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1656ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.603739:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.603746:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.603753:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.603902:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b1656fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.603912:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b1656fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.603920:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b1656fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782224304.603977:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b1656fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604062:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1656ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604070:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1656ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604078:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1656ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604084:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224304.604090:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1656ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604099:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1656ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604125:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:1.0:1782224304.604129:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224304.604135:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1656ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604142:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b1656ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604159:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604166:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604172:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604185:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224304.604188:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604195:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604204:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96ea8508ff00) 00010000:00010000:1.0:1782224304.604207:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224304.604209:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604215:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b1656f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604233:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b1656fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604240:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b1656fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604246:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b1656fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604251:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224304.604255:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b1656fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604261:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b1656fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604279:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:1.0:1782224304.604282:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224304.604285:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b1656fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.604291:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b1656fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224304.604399:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:11569:x1868797312064512:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 834us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224304.604408:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 204 00000100:00100000:3.0:1782224304.663390:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224304.663584:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312064768 00000100:00100000:1.0:1782224304.663597:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312064768 00000100:00100000:1.0:1782224304.663672:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 205 00000100:00100000:1.0:1782224304.663682:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+52:11572:x1868797312064768:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1782224304.663712:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224304.663740:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165703 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a518a2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.663838:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b16570a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.663855:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b16570a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.663869:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b16570a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.663885:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165711 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.663912:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.663919:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664205:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b165718 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664215:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b165718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664222:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b165718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224304.664234:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1782224304.664353:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b16570a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664362:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b16570a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664380:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b16570a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664387:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224304.664392:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b16570a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664401:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b16570a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664426:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:1.0:1782224304.664430:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224304.664436:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b16570a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664443:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55400/0xcfd8b3ae4b16570a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664460:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664466:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165711 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664471:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165711 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664476:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224304.664479:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165711 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664485:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165711 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664492:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96ea8508ff00) 00010000:00010000:1.0:1782224304.664494:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224304.664497:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165711 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664503:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165711 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664571:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165703 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518a2 expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664585:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b165718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518a2 expref: 54 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.664593:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:1.0:1782224304.664595:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782224304.664598:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d55a00, rc 0) 00000100:00100000:1.0:1782224304.664691:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:11572:x1868797312064768:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1010us (1328us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1782224304.664702:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 205 00000100:00100000:3.0:1782224304.667732:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224304.667836:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312064896 00000100:00100000:1.0:1782224304.667849:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312064896 00000100:00100000:1.0:1782224304.667927:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 206 00000100:00100000:1.0:1782224304.667940:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:11572:x1868797312064896:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:1.0:1782224304.668071:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b165726 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.668093:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b165726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.668107:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b165726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.668153:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b165726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.668177:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b165726 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.668185:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b165726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.668192:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224304.668197:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b165726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.668205:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b165726 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.668220:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:1.0:1782224304.668224:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782224304.668229:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b165726 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224304.668236:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54400/0xcfd8b3ae4b165726 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224304.668323:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:11572:x1868797312064896:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 386us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224304.668332:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 206 00000100:00100000:3.0:1782224304.672727:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224304.673096:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312065152 00000100:00100000:1.0:1782224304.673110:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312065152 00000100:00100000:1.0:1782224304.673374:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 58 00000100:00100000:1.0:1782224304.673388:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+54:11572:x1868797312065152:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:1.0:1782224304.673724:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:11572:x1868797312065152:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 338us (1009us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1782224304.673743:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 58 00000100:00100000:3.0:1782224304.807798:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224304.808647:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312065408 00000100:00100000:0.0:1782224304.808660:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312065408 00000100:00100000:0.0:1782224304.808734:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 207 00000100:00100000:0.0:1782224304.808744:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+55:11582:x1868797312065408:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:0.0:1782224304.808770:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224304.808773:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782224304.808830:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674400/0xcfd8b3ae4b1656a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51886 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.808852:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:0.0:1782224304.808857:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782224304.808869:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b16572d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a518a9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.808998:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b165734 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.809073:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b165734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.809086:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b165734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224304.809097:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1782224304.809227:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b16572d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518a9 expref: 57 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.809242:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b165734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518a9 expref: 56 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.809251:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:0.0:1782224304.809254:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782224304.809257:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74800, rc 0) 00000100:00100000:0.0:1782224304.809679:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+56:11582:x1868797312065408:12345-192.168.202.7@tcp:101:bash.0 Request processed in 935us (1890us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1782224304.809689:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 207 00000100:00100000:3.0:1782224304.815133:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224304.815208:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312065664 00000100:00100000:2.0:1782224304.815224:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312065664 00000100:00100000:2.0:1782224304.815303:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 208 00000100:00100000:2.0:1782224304.815315:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+56:11582:x1868797312065664:12345-192.168.202.7@tcp:36:bash.0 00010000:00010000:2.0:1782224304.815397:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782224304.815428:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74800/0xcfd8b3ae4b165734 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518a9 expref: 56 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.815454:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55a00/0xcfd8b3ae4b165718 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518a2 expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.815464:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:2.0:1782224304.815470:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224304.815675:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b165742 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.815703:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b165742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224304.815713:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b165742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782224304.815768:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1782224304.815804:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006de7ec42 reply state 00000000ee4484fd transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b165742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224304.815814:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782224304.815928:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:11582:x1868797312065664:12345-192.168.202.7@tcp:36:bash.0 Request processed in 613us (810us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1782224304.815936:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 208 00000020:00080000:2.0:1782224304.815942:0:6605:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782224304.823514:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b165742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.823534:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b165742 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.823541:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b165742 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.823547:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224304.823552:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b165742 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.823559:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b165742 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.823577:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:0.0:1782224304.823580:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224304.823585:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b165742 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.823591:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b165742 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224304.838717:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224304.838772:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312065792 00000100:00100000:0.0:1782224304.838781:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312065792 00000100:00100000:0.0:1782224304.838841:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 209 00000100:00100000:0.0:1782224304.838852:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+56:11582:x1868797312065792:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:0.0:1782224304.838876:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224304.838906:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b165749 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a518b0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.839009:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165750 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.839056:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.839076:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224304.839109:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1782224304.839113:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782224304.839134:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.839162:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b165749 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518b0 expref: 58 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.839180:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165750 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518b0 expref: 57 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224304.839190:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:0.0:1782224304.839192:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782224304.839197:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74600, rc 0) 00000100:00100000:0.0:1782224304.839254:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:11582:x1868797312065792:12345-192.168.202.7@tcp:101:bash.0 Request processed in 404us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224304.839261:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 209 00010000:00010000:0.0:1782224304.854111:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224304.859073:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224304.859631:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312066048 00000100:00100000:0.0:1782224304.859671:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312066048 00000100:00100000:0.0:1782224304.860512:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 59 00000100:00100000:0.0:1782224304.860529:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8327b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+57:11582:x1868797312066048:12345-192.168.202.7@tcp:35:bash.0 00000100:00100000:0.0:1782224304.861203:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8327b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+58:11582:x1868797312066048:12345-192.168.202.7@tcp:35:bash.0 Request processed in 542us (2006us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1782224304.861215:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 59 00000001:00080000:2.0:1782224304.900160:0:6608:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1782224304.900187:0:6608:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1782224304.900199:0:6608:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1782224305.024942:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224305.025078:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312066176 00000100:00100000:1.0:1782224305.025088:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312066176 00000100:00100000:1.0:1782224305.025159:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 210 00000100:00100000:1.0:1782224305.025170:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+58:11588:x1868797312066176:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1782224305.025196:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224305.025218:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a518b7 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.025298:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16575e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.025314:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16575e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.025514:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16575e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224305.025581:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1782224305.025585:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782224305.025608:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16575e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.025632:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518b7 expref: 60 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.025650:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16575e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518b7 expref: 59 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.025676:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:1.0:1782224305.025679:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782224305.025683:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d54a00, rc 0) 00000100:00100000:1.0:1782224305.025761:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+59:11588:x1868797312066176:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 592us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224305.025770:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 210 00000100:00080000:2.0:1782224305.025856:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224305.031181:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224305.031308:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312066304 00000100:00100000:0.0:1782224305.031325:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312066304 00000100:00100000:0.0:1782224305.031412:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 211 00000100:00100000:0.0:1782224305.031423:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+59:11588:x1868797312066304:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1782224305.031446:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224305.031467:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b165765 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a518be expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031536:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b16576c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031553:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b16576c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031564:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b16576c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031579:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b165773 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031587:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b165773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031593:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b165773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031705:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16577a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031715:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16577a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031722:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16577a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224305.031757:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1782224305.031762:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782224305.031780:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16577a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031791:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16577a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031799:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b16576c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031806:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b16576c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031812:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b16576c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031818:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224305.031822:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b16576c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031829:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b16576c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031849:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:0.0:1782224305.031852:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224305.031857:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b16576c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031863:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b16576c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031877:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b165773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031882:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b165773 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031887:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b165773 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031892:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224305.031894:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b165773 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031900:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b165773 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031906:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96eaa7d65300) 00010000:00010000:0.0:1782224305.031908:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224305.031911:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b165773 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031916:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b165773 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031957:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74c00/0xcfd8b3ae4b165765 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518be expref: 61 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031968:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16577a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518be expref: 60 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.031975:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:0.0:1782224305.031977:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782224305.031979:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74e00, rc 0) 00000100:00100000:0.0:1782224305.032142:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+60:11588:x1868797312066304:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 719us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224305.032150:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 211 00000100:00100000:3.0:1782224305.040859:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224305.040973:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312066432 00000100:00100000:2.0:1782224305.040989:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312066432 00000100:00100000:2.0:1782224305.041125:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:2.0:1782224305.041136:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+60:2349:x1868797312066432:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782224305.041154:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224305.041180:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74e00/0xcfd8b3ae4b16577a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518be expref: 60 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.041219:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:2.0:1782224305.041225:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224305.041290:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+59:2349:x1868797312066432:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 156us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224305.041298:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:3.0:1782224305.048204:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224305.051301:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312066688 00000100:00100000:0.0:1782224305.051325:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312066688 00000100:00100000:0.0:1782224305.051421:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 212 00000100:00100000:0.0:1782224305.051432:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+59:11588:x1868797312066688:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1782224305.051454:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224305.051477:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b165781 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a518c5 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.051583:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165788 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.051598:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165750 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518b0 expref: 60 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.051607:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165788 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.051657:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165750 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518b0 expref: 60 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.051670:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165750 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518b0 expref: 60 pid: 5787 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224305.051685:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf59c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333027072:192.168.202.7@tcp:104: 00000100:00100000:0.0:1782224305.051798:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaaa254900 going to sleep for 11 seconds 00000100:00100000:2.0:1782224305.060175:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf59c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333027072:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224305.060220:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165788 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224305.062194:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224305.062403:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312066816 00000100:00100000:0.0:1782224305.062415:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312066816 00010000:00010000:0.0:1782224305.062473:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165750 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518b0 expref: 61 pid: 5787 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224305.062532:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 77 00000100:00100000:0.0:1782224305.062545:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+61:2347:x1868797312066816:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224305.062564:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224305.062572:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165750 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518b0 expref: 61 pid: 5787 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.062588:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165750 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518b0 expref: 61 pid: 5787 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.062616:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165750 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518b0 expref: 61 pid: 5787 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.062637:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:0.0:1782224305.062661:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165788 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.062673:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165788 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.062681:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165788 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.062733:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224305.062813:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+60:2347:x1868797312066816:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 270us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224305.062822:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 77 00010000:00010000:2.0:1782224305.062836:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165788 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.062856:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165788 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224305.062884:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1782224305.063099:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74200/0xcfd8b3ae4b165781 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518c5 expref: 61 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.063119:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165788 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518c5 expref: 60 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.063128:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:2.0:1782224305.063130:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782224305.063134:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a75a00, rc 0) 00000100:00100000:2.0:1782224305.063194:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+60:11588:x1868797312066688:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 11763us (15004us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1782224305.063218:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 212 00000100:00100000:0.0:1782224305.066985:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224305.067266:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312067072 00000100:00100000:2.0:1782224305.067280:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312067072 00000100:00100000:2.0:1782224305.067392:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:2.0:1782224305.067405:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+60:11588:x1868797312067072:12345-192.168.202.7@tcp:103:lfs.0 00010000:00010000:2.0:1782224305.067430:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224305.067462:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74400/0xcfd8b3ae4b1656e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5189b expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.067489:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:2.0:1782224305.067506:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224305.067573:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+59:11588:x1868797312067072:12345-192.168.202.7@tcp:103:lfs.0 Request processed in 170us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224305.067582:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:1.0:1782224305.077678:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224305.077750:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312067200 00000100:00100000:0.0:1782224305.077767:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312067200 00000100:00100000:0.0:1782224305.077857:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 213 00000100:00100000:0.0:1782224305.077870:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+59:11588:x1868797312067200:12345-192.168.202.7@tcp:58:lfs.0 00010000:00010000:0.0:1782224305.078150:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165796 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.078173:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165796 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.078187:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165796 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782224305.079141:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1782224305.079371:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+59:11588:x1868797312067200:12345-192.168.202.7@tcp:58:lfs.0 Request processed in 1489us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224305.079382:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 213 00000100:00100000:2.0:1782224305.094775:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224305.108001:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312067328 00000100:00100000:3.0:1782224305.108042:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312067328 00000100:00100000:1.0:1782224305.108334:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 214 00000100:00100000:1.0:1782224305.108348:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8327b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+59:11588:x1868797312067328:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1782224305.108826:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224305.108857:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16579d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a518cc expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.109675:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165796 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.109842:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16579d lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518cc expref: 60 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.109870:0:6605:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165796 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.109989:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16579d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518cc expref: 60 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.110054:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:1.0:1782224305.110058:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782224305.110062:0:6605:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16579d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518cc expref: 60 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.110071:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d55800, rc 0) 00000100:00100000:1.0:1782224305.110168:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8327b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+60:11588:x1868797312067328:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1822us (15476us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224305.110177:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 214 00000040:00080000:2.0:1782224305.429982:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782224305.429996:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782224305.430064:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1782224305.430071:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782224305.430243:0:11523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83279880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11523:1868797333027200:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782224305.430402:0:11523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabf41c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224305.437655:0:11523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83279880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11523:1868797333027200:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782224305.444529:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224305.444997:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312067456 00000100:00100000:2.0:1782224305.445009:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312067456 00000100:00100000:2.0:1782224305.445124:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 215 00000100:00100000:2.0:1782224305.445137:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+60:11589:x1868797312067456:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782224305.445194:0:5786:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782224305.445372:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+60:11589:x1868797312067456:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 227us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224305.445381:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 215 00000100:00100000:2.0:1782224305.452248:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224305.452638:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312067584 00000100:00100000:0.0:1782224305.452650:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312067584 00000100:00100000:0.0:1782224305.452734:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 216 00000100:00100000:0.0:1782224305.452745:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+60:11589:x1868797312067584:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1782224305.452840:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1657a4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.452861:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1657a4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.452886:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1657a4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.452907:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1657ab lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.452914:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1657ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.452921:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1657ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.452948:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.452957:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.452963:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224305.453086:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1782224305.453091:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782224305.453107:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453120:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1657a4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453127:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1657a4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453134:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1657a4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453140:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224305.453145:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1657a4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453162:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1657a4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453176:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96ea87df7c00) 00010000:00010000:0.0:1782224305.453179:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224305.453185:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1657a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453192:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b1657a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453206:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1657ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453222:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1657ab lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453228:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1657ab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453233:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224305.453236:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1657ab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453243:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1657ab lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453251:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff96eaa7d65300) 00010000:00010000:0.0:1782224305.453254:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224305.453257:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1657ab lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453263:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b1657ab lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453280:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453286:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453292:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453296:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224305.453305:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453312:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453320:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:0.0:1782224305.453323:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224305.453326:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.453331:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224305.453938:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+60:11589:x1868797312067584:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 Request processed in 1189us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224305.453952:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 216 00000100:00100000:1.0:1782224305.465113:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224305.465241:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312067840 00000100:00100000:2.0:1782224305.465254:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312067840 00000100:00100000:2.0:1782224305.465337:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 217 00000100:00100000:2.0:1782224305.465349:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+60:11589:x1868797312067840:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782224305.465393:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224305.465421:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b1657b9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a518d3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.465567:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1657c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.465585:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1657c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.465598:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1657c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224305.465610:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1782224305.465736:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1657c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.465745:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1657c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.465752:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1657c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.465780:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224305.465785:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1657c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.465794:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1657c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.465808:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:2.0:1782224305.465812:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782224305.465817:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1657c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.465824:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1657c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.465877:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b1657b9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518d3 expref: 62 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.465888:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96ea87df7c00) 00010000:00010000:2.0:1782224305.465890:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782224305.465893:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b1657b9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518d3 expref: 62 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.465903:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab600, rc 0) 00000100:00100000:2.0:1782224305.465998:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+61:11589:x1868797312067840:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 651us (901us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1782224305.466008:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 217 00000100:00100000:3.0:1782224305.489368:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224305.489911:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312067968 00000100:00100000:1.0:1782224305.489925:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312067968 00000100:00100000:1.0:1782224305.490002:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 218 00000100:00100000:1.0:1782224305.490047:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+61:11589:x1868797312067968:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782224305.490098:0:6605:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782224305.490261:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+61:11589:x1868797312067968:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 248us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224305.490270:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 218 00000100:00100000:3.0:1782224305.506173:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224305.506292:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312068224 00000100:00100000:2.0:1782224305.506325:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312068224 00000100:00100000:2.0:1782224305.506421:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 219 00000100:00100000:2.0:1782224305.506435:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+61:11589:x1868797312068224:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782224305.506467:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224305.506471:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782224305.506518:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16575e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518b7 expref: 61 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.506544:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:2.0:1782224305.506550:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224305.506568:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1657ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a518da expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782224305.507212:0:5786:0:(osp_object.c:1673:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1782224305.507482:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1657d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.507499:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1657d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.507511:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1657d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.507578:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1657ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518da expref: 63 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.507598:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1657d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518da expref: 62 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.507622:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96ea8635fe00) 00010000:00010000:2.0:1782224305.507625:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782224305.507629:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaac00, rc 0) 00000100:00100000:2.0:1782224305.507723:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+62:11589:x1868797312068224:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 1291us (1572us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1782224305.507732:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 219 00000100:00100000:2.0:1782224305.513741:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224305.513846:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312068480 00000100:00100000:1.0:1782224305.513859:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312068480 00000100:00100000:1.0:1782224305.513941:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 220 00000100:00100000:1.0:1782224305.513953:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8327aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+62:11589:x1868797312068480:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782224305.514060:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224305.514094:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b1657d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518da expref: 62 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514140:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96ea8635fe00) 00010000:00010000:1.0:1782224305.514163:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782224305.514199:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1657e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514216:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1657e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514227:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1657e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514245:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1657ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xaee77337 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514253:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1657ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xaee77337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514259:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1657ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xaee77337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514380:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1657e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514389:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1657e3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514397:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1657e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514403:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54000 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224305.514409:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1657e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514424:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1657e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514434:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:1.0:1782224305.514437:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224305.514441:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1657e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514447:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54000/0xcfd8b3ae4b1657e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514457:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1657ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xaee77337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514463:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1657ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaee77337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514468:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1657ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaee77337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514473:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224305.514475:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1657ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaee77337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514480:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1657ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaee77337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514746:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xaee77337 (ffff96ea8508ff00) 00010000:00010000:1.0:1782224305.514750:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224305.514754:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1657ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xaee77337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.514771:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b1657ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xaee77337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224305.515094:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8327aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+61:11589:x1868797312068480:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 1142us (1366us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782224305.515104:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 220 00000100:00100000:1.0:1782224305.523010:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224305.523801:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312068608 00000100:00100000:2.0:1782224305.523814:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312068608 00000100:00100000:2.0:1782224305.523907:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 221 00000100:00100000:2.0:1782224305.523919:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+61:11589:x1868797312068608:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782224305.523947:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224305.523981:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1657f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a518e1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.524064:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1657f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.524081:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1657f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.524095:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1657f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.524380:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b1657f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518e1 expref: 63 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.524469:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1657f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518e1 expref: 62 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.524479:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:2.0:1782224305.524482:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782224305.524486:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbabc00, rc 0) 00000100:00100000:2.0:1782224305.524570:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+62:11589:x1868797312068608:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 652us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224305.524579:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 221 00000100:00100000:2.0:1782224305.530812:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224305.532090:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312068864 00000100:00100000:0.0:1782224305.532107:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312068864 00000100:00100000:0.0:1782224305.532202:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 222 00000100:00100000:0.0:1782224305.532216:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8327ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+62:11589:x1868797312068864:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782224305.532334:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.532369:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.532390:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782224305.534638:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1782224305.536377:0:5788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 386316358987ns, next at 387316337149ns, rc = 0 00000004:00010000:0.0:1782224305.537667:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f30a9232 reply state 000000006e046b63 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224305.537759:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782224305.537960:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8327ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+64:11589:x1868797312068864:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 5741us (7154us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1782224305.537971:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 222 00000100:00100000:3.0:1782224305.552373:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:2.0:1782224305.554829:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.554853:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.554861:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.554868:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224305.554873:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.554882:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.554905:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:2.0:1782224305.554908:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782224305.554936:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.554942:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75e00/0xcfd8b3ae4b1657ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224305.556077:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312068992 00000100:00100000:0.0:1782224305.556093:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312068992 00000100:00100000:0.0:1782224305.556291:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 223 00000100:00100000:0.0:1782224305.556305:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+63:11589:x1868797312068992:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782224305.556337:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224305.556373:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b165806 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a518e8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.556466:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b165806 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518e8 expref: 64 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.557997:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b165806 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518e8 expref: 64 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.558075:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:0.0:1782224305.558080:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782224305.558084:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a75c00, rc 0) 00000100:00100000:0.0:1782224305.559649:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+64:11589:x1868797312068992:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 3332us (7286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224305.559666:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 223 00000100:00100000:1.0:1782224305.568776:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224305.569164:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312069120 00000100:00100000:3.0:1782224305.569178:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312069120 00000100:00100000:3.0:1782224305.569277:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 62 00000100:00100000:3.0:1782224305.569292:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:2347:x1868797312069120:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1782224305.569760:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+10:2347:x1868797312069120:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 471us (998us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1782224305.569769:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 62 00000100:00080000:2.0:1782224305.571132:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782224305.575190:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224305.576792:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312069376 00000100:00100000:2.0:1782224305.576811:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312069376 00000100:00100000:3.0:1782224305.578763:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 60 00000100:00100000:3.0:1782224305.578805:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+64:11589:x1868797312069376:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782224305.580442:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+65:11589:x1868797312069376:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 1646us (5259us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1782224305.580461:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 60 00000100:00100000:1.0:1782224305.590409:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224305.590572:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312069632 00000100:00100000:2.0:1782224305.590585:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312069632 00000100:00100000:2.0:1782224305.590663:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 224 00000100:00100000:2.0:1782224305.590675:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+65:11589:x1868797312069632:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782224305.591113:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+65:11589:x1868797312069632:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 439us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224305.591122:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 224 00000100:00100000:1.0:1782224305.602516:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224305.602634:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312069760 00000100:00100000:2.0:1782224305.602647:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312069760 00000100:00100000:2.0:1782224305.602834:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 225 00000100:00100000:2.0:1782224305.602848:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+65:11589:x1868797312069760:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782224305.602884:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224305.602913:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b16580d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a518ef expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.603073:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b165814 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.603091:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b165814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.603117:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b165814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224305.603168:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224305.603193:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b165814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.603225:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b16580d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518ef expref: 67 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.603246:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b165814 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518ef expref: 66 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.603256:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:2.0:1782224305.603260:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782224305.603264:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaac00, rc 0) 00000100:00100000:2.0:1782224305.603342:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+66:11589:x1868797312069760:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 497us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224305.603350:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 225 00000100:00100000:1.0:1782224305.614178:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224305.614613:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312069888 00000100:00100000:3.0:1782224305.614627:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312069888 00000100:00100000:3.0:1782224305.614712:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 63 00000100:00100000:3.0:1782224305.614725:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+10:2346:x1868797312069888:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782224305.614750:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224305.614778:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f643605/0xcfd8b3ae4b16581b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a518f6 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782224305.614842:0:6582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a95b1, blocks: 0x1 00010000:00010000:3.0:1782224305.614885:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=386s v=(0 0) 00010000:00010000:3.0:1782224305.614891:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782224305.614903:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f643605/0xcfd8b3ae4b16581b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518f6 expref: 11 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224305.614928:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000f643605/0xcfd8b3ae4b16581b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518f6 expref: 11 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224305.614944:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675a00, rc 0) 00000100:00100000:3.0:1782224305.615045:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+11:2346:x1868797312069888:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 322us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224305.615054:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 63 00000100:00100000:1.0:1782224305.622492:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224305.622655:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312070144 00000100:00100000:0.0:1782224305.622668:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312070144 00000100:00100000:0.0:1782224305.622752:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 226 00000100:00100000:0.0:1782224305.622763:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+66:11589:x1868797312070144:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782224305.622908:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+66:11589:x1868797312070144:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 146us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224305.622916:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 226 00000100:00100000:3.0:1782224305.628326:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224305.628511:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312070272 00000100:00100000:0.0:1782224305.628525:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312070272 00000100:00100000:0.0:1782224305.628605:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00100000:0.0:1782224305.628618:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+11:11589:x1868797312070272:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782224305.628644:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224305.628668:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165822 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a518fd expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.628725:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000f643605/0xcfd8b3ae4b16581b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518f6 expref: 12 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.628736:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224305.628741:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224305.628747:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165822 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518fd expref: 12 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.628793:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000f643605/0xcfd8b3ae4b16581b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518f6 expref: 12 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.628809:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000f643605/0xcfd8b3ae4b16581b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518f6 expref: 12 pid: 6582 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224305.628846:0:6584:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf59fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6584:1868797333027328:192.168.202.7@tcp:104: 00000100:00100000:0.0:1782224305.629254:0:6584:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaaa254540 going to sleep for 11 seconds 00000100:00100000:0.0:1782224305.636266:0:6584:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf59fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6584:1868797333027328:192.168.202.7@tcp:104: 00010000:00010000:0.0:1782224305.636318:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165822 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518fd expref: 12 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.636372:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74a00, rc 0) 00000100:00100000:0.0:1782224305.636453:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+12:11589:x1868797312070272:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 7837us (8142us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224305.636465:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00100000:1.0:1782224305.646944:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224305.650243:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312070400 00000100:00100000:0.0:1782224305.650266:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312070400 00010000:00010000:0.0:1782224305.650342:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000f643605/0xcfd8b3ae4b16581b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518f6 expref: 12 pid: 6582 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224305.650440:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 78 00000100:00100000:0.0:1782224305.650452:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+12:2346:x1868797312070400:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224305.650479:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224305.650511:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000f643605/0xcfd8b3ae4b16581b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518f6 expref: 12 pid: 6582 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.650529:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000f643605/0xcfd8b3ae4b16581b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518f6 expref: 12 pid: 6582 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.650582:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f643605/0xcfd8b3ae4b16581b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518f6 expref: 12 pid: 6582 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.650609:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224305.650614:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224305.650625:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165822 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518fd expref: 11 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.650637:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165822 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518fd expref: 11 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.650690:0:5772:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165822 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518fd expref: 11 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224305.650707:0:5772:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf59fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5772:1868797333027456:192.168.202.7@tcp:105: 00000100:00100000:0.0:1782224305.650835:0:5772:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaaa254540 going to sleep for 11 seconds 00000100:00100000:0.0:1782224305.656209:0:5772:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf59fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5772:1868797333027456:192.168.202.7@tcp:105: 00010000:00010000:0.0:1782224305.656243:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224305.656310:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+11:2346:x1868797312070400:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 5858us (9381us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224305.656323:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 78 00000100:00100000:1.0:1782224305.656929:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224305.657052:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312070528 00000100:00100000:2.0:1782224305.657062:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312070528 00002000:00100000:2.0:1782224305.657122:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff96e986bbd880 x1868797312070528/t0(0) o4->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:6/0 lens 504/0 e 0 to 0 dl 1782224316 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782224305.657134:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96e986bbd880 with x1868797312070528 ext(0->12) 00002000:00010000:2.0:1782224305.657141:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96e986bbd880 00000100:00100000:2.0:1782224305.657165:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:2.0:1782224305.657176:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+11:2346:x1868797312070528:12345-192.168.202.7@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1782224305.658044:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:2346:x1868797312070528:12345-192.168.202.7@tcp:4:lhsmtool_posix.0 Request processed in 836us (1084us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1782224305.658054:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 6 00002000:00100000:2.0:1782224305.658061:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff96e986bbd880 x1868797312070528/t4294967320(0) o4->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:6/0 lens 504/448 e 0 to 0 dl 1782224316 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782224305.658070:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96e986bbd880 with x1868797312070528 ext(0->12) 00002000:00010000:2.0:1782224305.658074:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96e986bbd880 00000100:00100000:1.0:1782224305.666347:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224305.666462:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312070656 00000100:00100000:0.0:1782224305.666475:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312070656 00000100:00100000:0.0:1782224305.666590:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 227 00000100:00100000:0.0:1782224305.666603:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+66:11589:x1868797312070656:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1782224305.701900:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1782224305.701916:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1782224305.701960:0:5808:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96eabc8b6480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1782224305.701966:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff96eabf61de00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96eabc8b6cc0 00000020:00080000:1.0:1782224305.701969:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff96eabf61d000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96eaa7f27800 00000004:00080000:1.0:1782224305.702005:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1782224305.702041:0:5808:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96eabfbcd900 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1782224305.702044:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff96eabf52fa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96eabfbcd9c0 00000020:00080000:1.0:1782224305.702048:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff96ea83e72300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96e984cdb800 00000004:00080000:1.0:1782224305.702085:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1782224305.702104:0:5808:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1782224305.702136:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:1.0:1782224305.702178:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1782224305.702441:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1782224305.702591:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e986bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333027584:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782224305.702679:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224305.702880:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333027840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1782224305.703005:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782224305.703012:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333027712:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782224305.703065:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224305.703106:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333027584 00000100:00100000:1.0:1782224305.703114:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333027584 00000100:00100000:1.0:1782224305.703176:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333027712 00000100:00100000:1.0:1782224305.703180:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333027712 00000100:00100000:1.0:1782224305.703209:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782224305.703219:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333027584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782224305.703255:0:6585:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1782224305.703298:0:6585:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a3a95af, atime: 0x6a3a95b0, ctime: 0x6a3a95af, blocks: 0xb 00010000:00010000:1.0:1782224305.703307:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165829 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.703328:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=386s v=(0 0) 00010000:00010000:1.0:1782224305.703333:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224305.703340:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165829 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.703374:0:6585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165829 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.703402:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165829 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.703411:0:6585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165829 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.703432:0:6585:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782224305.703802:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782224305.703814:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1868797333027712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782224305.703831:0:6582:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1782224305.703850:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010776d15/0xcfd8b3ae4b165830 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.703868:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000054d63481/0xcfd8b3ae4b1655eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5185c expref: 12 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.703875:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782224305.703879:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782224305.703883:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010776d15/0xcfd8b3ae4b165830 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.703915:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000054d63481/0xcfd8b3ae4b1655eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5185c expref: 12 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.703945:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000054d63481/0xcfd8b3ae4b1655eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5185c expref: 12 pid: 6585 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224305.703960:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6582:1868797333027968:192.168.202.7@tcp:104: 00000100:00100000:2.0:1782224305.704070:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabf41cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1782224305.705082:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1868797333027584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1860us (2399us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1782224305.705094:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1782224305.705136:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782224305.705141:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782224305.705304:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224305.705349:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333027840 00000100:00100000:1.0:1782224305.705369:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333027840 00000100:00100000:1.0:1782224305.705403:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782224305.705413:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3303:x1868797333027840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1782224305.705571:0:6585:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1782224305.705575:0:6585:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1782224305 00002000:00010000:1.0:1782224305.705577:0:6585:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782224305.705580:0:6585:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1782224305 -> 1782224305 00002000:00010000:1.0:1782224305.705582:0:6585:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782224305.705617:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3303:x1868797333027840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 205us (312us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1782224305.705624:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1782224305.705670:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96ea83279f80/2, rc 0, transno 4294967321 00000100:00100000:1.0:1782224305.706502:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333027840:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1782224305.706614:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224305.706625:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165829 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.706640:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55a00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224305.706645:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165829 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.706659:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165829 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.706696:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165829 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.706706:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165829 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.706730:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224305.706732:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224305.706734:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224305.706861:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+20:11589:x1868797312070656:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 Request processed in 40258us (40528us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224305.706871:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 227 00000100:00100000:2.0:1782224305.710522:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1782224305.710539:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96eabf234700, transno 4294967307 00000004:00080000:2.0:1782224305.710554:0:3305:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:2.0:1782224305.710590:0:3305:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff96e986bbd180 x1868797333027584/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782224321 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1782224305.710604:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96e986bbd180/2, rc 0, transno 4294967310 00000100:00100000:2.0:1782224305.710609:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e986bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333027584:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782224305.711956:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224305.712699:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312070784 00000100:00100000:3.0:1782224305.712712:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312070784 00010000:00010000:3.0:1782224305.712762:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000054d63481/0xcfd8b3ae4b1655eb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5185c expref: 13 pid: 6585 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224305.712842:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 79 00000100:00100000:3.0:1782224305.712852:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8757f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:2347:x1868797312070784:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224305.712882:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224305.712890:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000054d63481/0xcfd8b3ae4b1655eb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5185c expref: 13 pid: 6585 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224305.712926:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000054d63481/0xcfd8b3ae4b1655eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5185c expref: 13 pid: 6585 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224305.712960:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782224305.712966:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782224305.712974:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000010776d15/0xcfd8b3ae4b165830 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224305.712986:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010776d15/0xcfd8b3ae4b165830 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224305.713012:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224305.713114:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8757f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+13:2347:x1868797312070784:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 262us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224305.713123:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 79 00010000:00010000:2.0:1782224305.714285:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054d63481/0xcfd8b3ae4b1655eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5185c expref: 12 pid: 6585 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224305.714312:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6582:1868797333027968:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224305.714338:0:6582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000010776d15/0xcfd8b3ae4b165830 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.714352:0:6582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000010776d15/0xcfd8b3ae4b165830 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.714374:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010776d15/0xcfd8b3ae4b165830 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.714398:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010776d15/0xcfd8b3ae4b165830 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.714406:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010776d15/0xcfd8b3ae4b165830 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.714433:0:6582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224305.715040:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224305.715049:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010776d15/0xcfd8b3ae4b165830 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.715071:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa600 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224305.715077:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010776d15/0xcfd8b3ae4b165830 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.715088:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010776d15/0xcfd8b3ae4b165830 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.715108:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010776d15/0xcfd8b3ae4b165830 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.715115:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010776d15/0xcfd8b3ae4b165830 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.715136:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224305.715138:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224305.715139:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224305.715466:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3305:x1868797333027712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11651us (12397us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1782224305.715476:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:2.0:1782224305.715546:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96ea83278e00/2, rc 0, transno 4294967322 00000100:00100000:2.0:1782224305.715554:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333027712:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782224305.717314:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224305.717415:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312070912 00000100:00100000:2.0:1782224305.717427:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312070912 00000100:00100000:2.0:1782224305.717494:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 68 00000100:00100000:2.0:1782224305.717506:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+12:2346:x1868797312070912:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1782224305.756489:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+12:2346:x1868797312070912:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 Request processed in 38971us (39171us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224305.756505:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 68 00000001:00080000:1.0:1782224305.756598:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:1.0:1782224305.756613:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1782224305.756619:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1782224305.756626:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1782224305.756631:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:1.0:1782224305.760257:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224305.760376:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312071168 00000100:00100000:0.0:1782224305.760391:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312071168 00000100:00100000:0.0:1782224305.760469:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 228 00000100:00100000:0.0:1782224305.760480:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+20:11589:x1868797312071168:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782224305.760559:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224305.760597:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b165814 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518ef expref: 20 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.760623:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:0.0:1782224305.760645:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782224305.760686:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b165837 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.760847:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b165837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.760860:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b165837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782224305.761326:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009a13b3af reply state 00000000a4451f13 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b165837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224305.761340:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782224305.761614:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+21:11589:x1868797312071168:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 1132us (1369us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1782224305.761623:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 228 00010000:00010000:0.0:1782224305.768384:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b165837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.768410:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b165837 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.768419:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b165837 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.768426:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224305.768432:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b165837 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.768441:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b165837 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.768492:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:0.0:1782224305.768496:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224305.768502:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b165837 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.768509:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b165837 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224305.770913:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224305.771169:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312071296 00000100:00100000:0.0:1782224305.771183:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312071296 00000100:00100000:0.0:1782224305.771260:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:0.0:1782224305.771274:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312071296:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782224305.771652:0:6584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1782224305.771658:0:6584:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1782224305 -> 1782224304 00002000:00010000:0.0:1782224305.771661:0:6584:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1782224304 00002000:00010000:0.0:1782224305.771663:0:6584:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1782224305 -> 1782224304 00002000:00010000:0.0:1782224305.771666:0:6584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1782224305.771747:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2346:x1868797312071296:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 475us (846us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1782224305.771757:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:1.0:1782224305.775372:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224305.775493:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312071552 00000100:00100000:2.0:1782224305.775506:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312071552 00000100:00100000:2.0:1782224305.775593:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 229 00000100:00100000:2.0:1782224305.775606:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+20:11589:x1868797312071552:12345-192.168.202.7@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1782224305.775726:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b16583e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.775748:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1657f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518e1 expref: 20 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.775786:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b16583e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.775834:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1657f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518e1 expref: 20 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.775851:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1657f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518e1 expref: 20 pid: 5786 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224305.775868:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1868797333028096:192.168.202.7@tcp:104: 00000100:00100000:2.0:1782224305.775995:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabf41c900 going to sleep for 11 seconds 00000100:00100000:3.0:1782224305.779496:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224305.779623:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312071680 00000100:00100000:0.0:1782224305.779635:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312071680 00010000:00010000:0.0:1782224305.779703:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1657f8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518e1 expref: 21 pid: 5786 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224305.779754:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 80 00000100:00100000:0.0:1782224305.779766:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+21:2346:x1868797312071680:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224305.779809:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224305.779817:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1657f8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518e1 expref: 21 pid: 5786 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.779833:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1657f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518e1 expref: 21 pid: 5786 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.779861:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:0.0:1782224305.779867:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b16583e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.779891:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b16583e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.779900:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b16583e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.779925:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224305.780004:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+21:2346:x1868797312071680:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 240us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224305.780057:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 80 00010000:00010000:2.0:1782224305.780953:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabc00/0xcfd8b3ae4b1657f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518e1 expref: 20 pid: 5786 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224305.780980:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1868797333028096:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224305.781007:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b16583e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.781077:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b16583e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.781084:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b16583e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.781124:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b16583e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.781131:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b16583e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.781155:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b16583e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.781162:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224305.781168:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b16583e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.781177:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b16583e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.781190:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:2.0:1782224305.781194:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1782224305.781200:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b16583e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.781206:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab600/0xcfd8b3ae4b16583e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224305.781347:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+19:11589:x1868797312071552:12345-192.168.202.7@tcp:55:lhsmtool_posix.0 Request processed in 5743us (6003us total) trans 0 rc -22/-22 00000100:00100000:2.0:1782224305.781371:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 229 00000100:00100000:3.0:1782224305.785956:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224305.786526:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312071808 00000100:00100000:1.0:1782224305.786541:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312071808 00000100:00100000:1.0:1782224305.786621:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 70 00000100:00100000:1.0:1782224305.786633:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2346:x1868797312071808:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1782224305.786708:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d4da9604/0xcfd8b3ae4b165845 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.786737:0:6715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165822 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518fd expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.786748:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224305.786753:0:6715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782224305.786758:0:6715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4da9604/0xcfd8b3ae4b165845 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.786805:0:6715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165822 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518fd expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.786844:0:6715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165822 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518fd expref: 8 pid: 6584 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224305.786864:0:6715:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcb8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6715:1868797333028224:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224305.786998:0:6715:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfda80 going to sleep for 11 seconds 00000100:00100000:1.0:1782224305.791223:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224305.791366:0:6715:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcb8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6715:1868797333028224:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224305.791402:0:6715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d4da9604/0xcfd8b3ae4b165845 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224305.791497:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312071936 00000100:00100000:0.0:1782224305.791506:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312071936 00010000:00010000:0.0:1782224305.791551:0:8291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165822 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518fd expref: 9 pid: 6584 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224305.791598:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 81 00000100:00100000:0.0:1782224305.791610:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+9:2347:x1868797312071936:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224305.791645:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224305.791674:0:8291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165822 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518fd expref: 9 pid: 6584 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.791698:0:8291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165822 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518fd expref: 9 pid: 6584 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.791726:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165822 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518fd expref: 9 pid: 6584 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.791745:0:8291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782224305.791749:0:8291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782224305.791755:0:8291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4da9604/0xcfd8b3ae4b165845 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.791766:0:8291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4da9604/0xcfd8b3ae4b165845 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.791803:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224305.791879:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2347:x1868797312071936:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 262us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224305.791887:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 81 00010000:00010000:2.0:1782224305.792002:0:6715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d4da9604/0xcfd8b3ae4b165845 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.792060:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4da9604/0xcfd8b3ae4b165845 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.792091:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d4da9604/0xcfd8b3ae4b165845 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.792100:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4da9604/0xcfd8b3ae4b165845 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.792110:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4da9604/0xcfd8b3ae4b165845 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.792117:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55000 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:2.0:1782224305.792122:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4da9604/0xcfd8b3ae4b165845 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.792131:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4da9604/0xcfd8b3ae4b165845 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.792145:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4da9604/0xcfd8b3ae4b165845 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.792151:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4da9604/0xcfd8b3ae4b165845 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224305.792218:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312071808:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 Request processed in 5587us (6278us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224305.792227:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 70 00000100:00100000:2.0:1782224305.796353:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224305.796477:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312072192 00000100:00100000:1.0:1782224305.796490:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312072192 00000100:00100000:1.0:1782224305.796610:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 230 00000100:00100000:1.0:1782224305.796623:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8327a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+19:11589:x1868797312072192:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1782224305.796747:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16584c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.796773:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16584c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.796788:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16584c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.797129:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165853 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.797143:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b165806 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518e8 expref: 20 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.797154:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165853 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.797220:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b165806 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518e8 expref: 20 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.797237:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b165806 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518e8 expref: 20 pid: 5786 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224305.797255:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1868797333028352:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224305.797378:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224305.800448:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1868797333028352:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224305.800489:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165853 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224305.802529:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224305.802636:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312072320 00000100:00100000:0.0:1782224305.802649:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312072320 00010000:00010000:0.0:1782224305.802714:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b165806 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518e8 expref: 21 pid: 5786 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224305.802788:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 82 00000100:00100000:0.0:1782224305.802800:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83279180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+21:2346:x1868797312072320:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224305.802821:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224305.802829:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b165806 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518e8 expref: 21 pid: 5786 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.802843:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b165806 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518e8 expref: 21 pid: 5786 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.802879:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75c00/0xcfd8b3ae4b165806 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518e8 expref: 21 pid: 5786 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.802900:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:0.0:1782224305.802907:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165853 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.802918:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165853 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.802927:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165853 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.802967:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224305.803076:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83279180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+20:2346:x1868797312072320:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 278us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224305.803086:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 82 00010000:00010000:2.0:1782224305.803304:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165853 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.803313:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165853 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782224305.803571:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1782224305.803730:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1782224305.803772:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1782224305.803867:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83279880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6605:1868797333028480:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782224305.803929:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224305.803955:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabf41c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782224305.804206:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333028480 00000100:00100000:1.0:1782224305.804214:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333028480 00000100:00100000:1.0:1782224305.804262:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782224305.804272:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8327a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6605:x1868797333028480:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782224305.804375:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8327a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6605:x1868797333028480:12345-0@lo:1000:mdt00_003.0 Request processed in 105us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224305.804383:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782224305.806217:0:6605:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1782224305.806255:0:6605:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96eaa7a0ad80, transno 4294967315 00000004:00080000:0.0:1782224305.806272:0:6605:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:0.0:1782224305.806299:0:6605:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96ea83279f80, transno 4294967321 00000004:00080000:0.0:1782224305.806302:0:6605:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96ea83278e00, transno 4294967322 00000100:00100000:0.0:1782224305.806313:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83279880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6605:1868797333028480:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1782224305.806877:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1782224305.806969:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf59fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6605:1868797333028608:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782224305.807073:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224305.807100:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea889aa840 going to sleep for 11 seconds 00000100:00100000:1.0:1782224305.807302:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333028608 00000100:00100000:1.0:1782224305.807312:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333028608 00000100:00100000:1.0:1782224305.807394:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782224305.807407:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6605:x1868797333028608:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782224305.807675:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6605:x1868797333028608:12345-0@lo:1000:mdt00_003.0 Request processed in 270us (601us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1782224305.807695:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782224305.808162:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf59fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6605:1868797333028608:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1782224305.808210:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165853 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.808220:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165853 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.808226:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165853 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.808232:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224305.808238:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165853 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.808247:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165853 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.808267:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:0.0:1782224305.808270:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782224305.808275:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165853 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.808301:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165853 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.808341:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165796 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.808346:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165796 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.808350:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165796 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.808353:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224305.808367:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165796 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.808374:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165796 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.808383:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:0.0:1782224305.808385:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782224305.808394:0:6605:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16579d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518cc expref: 23 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.808412:0:6605:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16579d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518cc expref: 23 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.808422:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16579d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518cc expref: 23 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.808470:0:6605:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16579d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518cc expref: 23 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224305.808484:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf59f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1868797333028736:192.168.202.7@tcp:105: 00000100:00100000:0.0:1782224305.808563:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea945ff780 going to sleep for 11 seconds 00000004:00080000:2.0:1782224305.808779:0:7851:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:2.0:1782224305.815123:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224305.815262:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312072448 00000100:00100000:0.0:1782224305.815275:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312072448 00000100:00100000:0.0:1782224305.815348:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00100000:0.0:1782224305.815370:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+24:11588:x1868797312072448:12345-192.168.202.7@tcp:49:lfs.0 00000100:00100000:0.0:1782224305.815565:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+24:11588:x1868797312072448:12345-192.168.202.7@tcp:49:lfs.0 Request processed in 207us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224305.815573:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00100000:1.0:1782224305.816250:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf59f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1868797333028736:192.168.202.7@tcp:105: 00010000:00010000:1.0:1782224305.816286:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165796 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.816321:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74600/0xcfd8b3ae4b165796 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.816376:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16585a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.816396:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16585a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.816410:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16585a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.816423:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16585a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.816430:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16585a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.816438:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16585a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.816445:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224305.816450:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16585a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.816458:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16585a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.816473:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:1.0:1782224305.816476:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224305.816481:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16585a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.816494:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54200/0xcfd8b3ae4b16585a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.816506:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16584c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.816513:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16584c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.816519:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16584c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.816524:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224305.816528:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16584c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.816533:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16584c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.816541:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:1.0:1782224305.816544:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782224305.816547:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16584c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224305.816553:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b16584c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224305.816924:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8327a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+23:11589:x1868797312072192:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 20302us (20585us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1782224305.816935:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 230 00000020:00080000:1.0:1782224305.816945:0:6605:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1782224305.821176:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782224305.821187:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782224305.821724:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1782224305.821734:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782224305.824169:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224305.824230:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224305.824336:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312072704 00000100:00100000:0.0:1782224305.824349:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312072704 00000100:00100000:0.0:1782224305.824438:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 231 00000100:00100000:0.0:1782224305.824450:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+23:11588:x1868797312072704:12345-192.168.202.7@tcp:58:lfs.0 00000040:00080000:0.0:1782224305.824935:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1782224305.825124:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+23:11588:x1868797312072704:12345-192.168.202.7@tcp:58:lfs.0 Request processed in 675us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224305.825134:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 231 00000100:00100000:3.0:1782224305.825620:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312072960 00000100:00100000:3.0:1782224305.825629:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312072960 00000100:00100000:3.0:1782224305.825674:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 62 00000100:00100000:3.0:1782224305.825690:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea9c44c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+23:11589:x1868797312072960:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782224305.826409:0:11907:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782224305.826542:0:11907:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1782224305.826595:0:11907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165861 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224305.826615:0:11907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165861 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224305.826629:0:11907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165861 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224305.826638:0:11907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165861 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224305.826645:0:11907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165861 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224305.826651:0:11907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165861 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224305.826679:0:11907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782224305.826777:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea9c44c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+25:11589:x1868797312072960:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 1086us (2544us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1782224305.826786:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 62 00000020:00080000:3.0:1782224305.826792:0:11907:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782224305.826857:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782224305.826864:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165861 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224305.826873:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675c00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224305.826879:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165861 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224305.826897:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165861 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224305.826913:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96ea87df7200) 00010000:00010000:3.0:1782224305.826916:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782224305.826921:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165861 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224305.826926:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b165861 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224305.826949:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224305.826951:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224305.826953:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224305.862634:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224305.862798:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312073088 00000100:00100000:2.0:1782224305.862811:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312073088 00000100:00100000:2.0:1782224305.863060:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 232 00000100:00100000:2.0:1782224305.863073:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+25:11591:x1868797312073088:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1782224305.863107:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224305.863134:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b165868 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51904 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.863220:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b16586f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.863237:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b16586f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.863250:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b16586f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.863266:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165876 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.863273:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.863280:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.863650:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16587d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.863663:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165788 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518c5 expref: 26 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.863673:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16587d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.863739:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165788 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518c5 expref: 26 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.863756:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165788 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518c5 expref: 26 pid: 5788 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224305.863774:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83278380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333028864:192.168.202.7@tcp:104: 00000100:00100000:2.0:1782224305.864115:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabf41c180 going to sleep for 11 seconds 00000100:00100000:2.0:1782224305.866991:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83278380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1868797333028864:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224305.867439:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16587d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224305.868721:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224305.868863:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312073344 00000100:00100000:2.0:1782224305.868885:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312073344 00000100:00100000:2.0:1782224305.868950:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 63 00000100:00100000:2.0:1782224305.868961:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+27:5562:x1868797312073344:12345-192.168.202.7@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1782224305.869329:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+28:5562:x1868797312073344:12345-192.168.202.7@tcp:35:ldlm_bl.0 Request processed in 367us (616us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1782224305.869339:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 63 00000100:00100000:3.0:1782224305.872392:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224305.872503:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312073472 00000100:00100000:0.0:1782224305.872516:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312073472 00010000:00010000:0.0:1782224305.872568:0:8291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165788 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518c5 expref: 28 pid: 5788 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224305.872669:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 83 00000100:00100000:0.0:1782224305.872690:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf844e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+28:2346:x1868797312073472:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224305.872710:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224305.872719:0:8291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165788 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518c5 expref: 28 pid: 5788 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.872733:0:8291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165788 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518c5 expref: 28 pid: 5788 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.872761:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165788 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518c5 expref: 28 pid: 5788 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.872782:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:0.0:1782224305.872788:0:8291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16587d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.872799:0:8291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16587d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.872808:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16587d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224305.872845:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224305.873118:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16587d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873129:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16587d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224305.873186:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1782224305.873199:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224305.873227:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16587d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873241:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16587d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873253:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b16586f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873259:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b16586f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873266:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b16586f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873273:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224305.873278:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b16586f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873286:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b16586f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873296:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:2.0:1782224305.873299:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224305.873304:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b16586f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873310:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab400/0xcfd8b3ae4b16586f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873323:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873340:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165876 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873347:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873353:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaae00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224305.873368:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873376:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165876 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873385:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96ea8635f200) 00010000:00010000:2.0:1782224305.873388:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224305.873391:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165876 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873397:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165876 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873439:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa800/0xcfd8b3ae4b165868 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51904 expref: 28 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873454:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16587d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51904 expref: 27 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224305.873463:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:2.0:1782224305.873465:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782224305.873473:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaa200, rc 0) 00000100:00100000:0.0:1782224305.873567:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf844e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+27:2346:x1868797312073472:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 888us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224305.873576:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 83 00000100:00100000:2.0:1782224305.874267:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+26:11591:x1868797312073088:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 11194us (11648us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224305.874277:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 232 00010000:00010000:0.0:1782224305.881066:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782224306.761359:0:12404:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782224306.761372:0:12404:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782224306.761429:0:12404:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1782224306.761436:0:12404:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1782224306.837089:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782224306.837101:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782224306.837147:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1782224306.837154:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782224306.837336:0:11523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83278380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11523:1868797333028992:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782224306.837475:0:11523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8352c900 going to sleep for 11 seconds 00000100:00100000:3.0:1782224306.846657:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224306.847978:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312073600 00000100:00100000:0.0:1782224306.847997:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312073600 00000100:00100000:0.0:1782224306.848108:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 233 00000100:00100000:0.0:1782224306.848121:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+27:11603:x1868797312073600:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782224306.848170:0:5786:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782224306.848321:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+27:11603:x1868797312073600:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 202us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224306.848330:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 233 00000100:00100000:2.0:1782224306.850504:0:11523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83278380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11523:1868797333028992:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782224306.852504:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224306.852724:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312073856 00000100:00100000:0.0:1782224306.852737:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312073856 00000100:00100000:0.0:1782224306.852825:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 234 00000100:00100000:0.0:1782224306.852836:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+26:11603:x1868797312073856:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782224306.852868:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224306.852895:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165884 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5190b expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224306.853289:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b16588b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224306.853311:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b16588b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224306.853328:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b16588b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224306.853377:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1782224306.853518:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75a00/0xcfd8b3ae4b165884 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5190b expref: 29 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224306.853534:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b16588b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5190b expref: 28 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224306.853541:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:0.0:1782224306.853543:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782224306.853546:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74a00, rc 0) 00000100:00100000:0.0:1782224306.853622:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+28:11603:x1868797312073856:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 787us (1131us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1782224306.853631:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 234 00000100:00100000:3.0:1782224306.857533:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224306.857605:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312074112 00000100:00100000:2.0:1782224306.857619:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312074112 00000100:00100000:2.0:1782224306.857701:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 235 00000100:00100000:2.0:1782224306.857714:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+28:11603:x1868797312074112:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782224306.857820:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b165899 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224306.857842:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b165899 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224306.857856:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b165899 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224306.858167:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b165899 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224306.858176:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b165899 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224306.858207:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b165899 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224306.858213:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbab000 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224306.858218:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b165899 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224306.858228:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b165899 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224306.858242:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:2.0:1782224306.858246:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782224306.858250:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b165899 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224306.858258:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbab000/0xcfd8b3ae4b165899 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224306.858457:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+29:11603:x1868797312074112:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 744us (938us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1782224306.858468:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 235 00000100:00100000:2.0:1782224306.859828:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224306.859872:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312074240 00000100:00100000:2.0:1782224306.859884:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312074240 00000040:00080000:3.0:1782224306.859921:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782224306.859928:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1782224306.859950:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:2.0:1782224306.859962:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83278380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+29:2346:x1868797312074240:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782224306.859981:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224306.860008:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74a00/0xcfd8b3ae4b16588b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5190b expref: 29 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224306.860060:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:2.0:1782224306.860066:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:3.0:1782224306.860563:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1782224306.860576:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782224306.860576:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83278380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+28:2346:x1868797312074240:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 165us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224306.860592:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:2.0:1782224306.863004:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224306.863197:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312074496 00000100:00100000:3.0:1782224306.863209:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312074496 00000100:00100000:3.0:1782224306.863277:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00100000:3.0:1782224306.863289:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8327bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+28:11603:x1868797312074496:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782224306.863614:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8327bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+29:11603:x1868797312074496:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 325us (621us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1782224306.863624:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 64 00010000:00010000:0.0:1782224306.902727:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224307.284577:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782224307.284629:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333029120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782224307.284753:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224307.284990:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333029120 00000100:00100000:3.0:1782224307.285003:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333029120 00000100:00100000:3.0:1782224307.285125:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782224307.285139:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1868797333029120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782224307.285212:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224307.285297:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1868797333029120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224307.285307:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782224307.285400:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333029120:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782224307.285904:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782224307.924526:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224308.308282:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eac1d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797333029376:0@lo:400:kworker.0 00000100:00100000:1.0:1782224308.308392:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224308.308454:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333029888:0@lo:400:kworker.0 00000100:00100000:1.0:1782224308.308482:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224308.308518:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782224308.308524:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabd0f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797333029248:0@lo:400:kworker.0 00000100:00100000:1.0:1782224308.308554:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224308.308577:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333029760:0@lo:400:kworker.0 00000100:00100000:1.0:1782224308.308600:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224308.308628:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eac1d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333029504:0@lo:400:kworker.0 00000100:00100000:1.0:1782224308.308652:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224308.308685:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782224308.308690:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333029632:0@lo:400:kworker.0 00000100:00100000:1.0:1782224308.308713:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224308.308746:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333029376 00000100:00100000:1.0:1782224308.308755:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333029376 00000100:00100000:1.0:1782224308.308804:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333029760 00000100:00100000:1.0:1782224308.308806:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333029760 00000100:00100000:1.0:1782224308.308830:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333029504 00000100:00100000:1.0:1782224308.308833:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333029504 00000100:00100000:1.0:1782224308.308862:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782224308.308886:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797333029376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224308.308952:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797333029376:12345-0@lo:400:kworker.0 Request processed in 67us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224308.308960:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782224308.308984:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1782224308.308990:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797333029760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224308.309050:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797333029760:12345-0@lo:400:kworker.0 Request processed in 60us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224308.309057:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1782224308.309069:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1782224308.309076:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333029504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224308.309110:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333029504:12345-0@lo:400:kworker.0 Request processed in 34us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224308.309116:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1782224308.309137:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333029888 00000100:00100000:1.0:1782224308.309140:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333029888 00000100:00100000:1.0:1782224308.309168:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333029632 00000100:00100000:1.0:1782224308.309171:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333029632 00000100:00100000:1.0:1782224308.309186:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782224308.309192:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1868797333029888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224308.309224:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1868797333029888:12345-0@lo:400:kworker.0 Request processed in 32us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224308.309230:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782224308.309241:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782224308.309248:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1868797333029632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224308.309274:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1868797333029632:12345-0@lo:400:kworker.0 Request processed in 27us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224308.309288:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782224308.309307:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333029248 00000100:00100000:1.0:1782224308.309311:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333029248 00000100:00100000:1.0:1782224308.309350:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1782224308.309357:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797333029248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224308.309387:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797333029248:12345-0@lo:400:kworker.0 Request processed in 32us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224308.309393:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:1.0:1782224308.309428:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782224308.309434:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224308.309476:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333029632:0@lo:400:kworker.0 00000100:00100000:1.0:1782224308.309488:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eac1d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333029504:0@lo:400:kworker.0 00000100:00100000:1.0:1782224308.309524:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabd0f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797333029248:0@lo:400:kworker.0 00000100:00100000:1.0:1782224308.309535:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333029760:0@lo:400:kworker.0 00000100:00100000:1.0:1782224308.309547:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eac1d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797333029376:0@lo:400:kworker.0 00000100:00100000:1.0:1782224308.309556:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333029888:0@lo:400:kworker.0 00000040:00080000:3.0:1782224308.717503:0:12455:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782224308.717516:0:12455:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782224308.717569:0:12455:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1782224308.717577:0:12455:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782224308.752496:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224308.752590:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224308.752632:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224308.752657:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224308.752684:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224308.752756:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312074880 00000100:00100000:3.0:1782224308.752769:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312074880 00000100:00100000:3.0:1782224308.752848:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312075008 00000100:00100000:3.0:1782224308.752852:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312075008 00000100:00100000:3.0:1782224308.752881:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 96 00000100:00100000:3.0:1782224308.752893:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2347:x1868797312074880:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224308.752990:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2347:x1868797312074880:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 99us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224308.752998:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 96 00000100:00100000:3.0:1782224308.753053:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 97 00000100:00100000:3.0:1782224308.753061:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2347:x1868797312075008:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224308.753088:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2347:x1868797312075008:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224308.753107:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 97 00000100:00080000:0.0:1782224308.753426:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782224308.753431:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782224308.755724:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312075136 00000100:00100000:0.0:1782224308.755739:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312075136 00000100:00100000:0.0:1782224308.755835:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312074752 00000100:00100000:0.0:1782224308.755848:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312074752 00000100:00100000:0.0:1782224308.755879:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 164 00000100:00100000:0.0:1782224308.755889:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2347:x1868797312075136:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224308.755979:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2347:x1868797312075136:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 91us (3346us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224308.755989:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 164 00000100:00100000:0.0:1782224308.756006:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 165 00000100:00100000:0.0:1782224308.756034:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+29:2347:x1868797312074752:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224308.756071:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+29:2347:x1868797312074752:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 58us (3413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224308.756077:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 165 00000100:00100000:1.0:1782224308.756493:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312074624 00000100:00100000:1.0:1782224308.756500:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312074624 00000100:00100000:1.0:1782224308.756557:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 299 00000100:00100000:1.0:1782224308.756566:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2347:x1868797312074624:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224308.756608:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2347:x1868797312074624:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 43us (4128us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224308.756614:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 299 00000100:00080000:2.0:1782224308.757043:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224308.820512:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782224308.820540:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333030016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782224308.820711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224308.820812:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333030016 00000100:00100000:2.0:1782224308.820824:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333030016 00000100:00100000:2.0:1782224308.821007:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782224308.821043:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8327b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1868797333030016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782224308.821090:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224308.821143:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8327b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1868797333030016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224308.821150:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782224308.821209:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333030016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782224308.951319:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224308.951392:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312075392 00000100:00100000:3.0:1782224308.951405:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312075392 00000100:00100000:3.0:1782224308.951475:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 236 00000100:00100000:3.0:1782224308.951486:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+29:11623:x1868797312075392:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1782224308.951516:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224308.951542:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1658a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51912 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224308.951681:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1658a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224308.951699:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1658a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224308.951716:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1658a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224308.951731:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1782224308.951962:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675c00/0xcfd8b3ae4b1658a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51912 expref: 32 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224308.951985:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1658a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51912 expref: 31 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224308.951994:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:3.0:1782224308.951997:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782224308.952030:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674800, rc 0) 00000100:00100000:3.0:1782224308.952104:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+31:11623:x1868797312075392:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 618us (873us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1782224308.952112:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 236 00010000:00010000:2.0:1782224308.954194:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224308.957309:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224308.957391:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312075520 00000100:00100000:0.0:1782224308.957405:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312075520 00000100:00100000:0.0:1782224308.958395:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 237 00000100:00100000:0.0:1782224308.958416:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+31:11623:x1868797312075520:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:0.0:1782224308.958512:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1658b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224308.958535:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1658b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224308.958549:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1658b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224308.958588:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1658b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224308.958618:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1658b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224308.958626:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1658b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224308.958633:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224308.958638:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1658b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224308.958647:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1658b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224308.958661:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:0.0:1782224308.958665:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782224308.958670:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1658b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224308.958678:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75200/0xcfd8b3ae4b1658b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224308.958786:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+31:11623:x1868797312075520:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 378us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224308.958794:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 237 00000100:00100000:3.0:1782224309.062921:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224309.063426:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312075648 00000100:00100000:1.0:1782224309.063440:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312075648 00000100:00100000:1.0:1782224309.063515:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 71 00000100:00100000:1.0:1782224309.063526:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312075648:12345-192.168.202.7@tcp:101:cat.0 00010000:00010000:1.0:1782224309.063548:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224309.063569:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b1658bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51919 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782224309.063595:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a3a95b0, atime: 0x6a3a95b0, ctime: 0x6a3a95b0, blocks: 0xb 00010000:00010000:1.0:1782224309.063613:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=389s v=(0 0) 00010000:00010000:1.0:1782224309.063616:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224309.063625:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b1658bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51919 expref: 8 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224309.063641:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b1658bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51919 expref: 8 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224309.063653:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d54800, rc 0) 00000100:00100000:1.0:1782224309.063720:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2346:x1868797312075648:12345-192.168.202.7@tcp:101:cat.0 Request processed in 196us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224309.063727:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 71 00000100:00100000:3.0:1782224309.068820:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224309.071389:0:11906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312075776 00000100:00100000:2.0:1782224309.071406:0:11906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312075776 00002000:00100000:2.0:1782224309.071474:0:11906:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff96eabf846a00 x1868797312075776/t0(0) o3->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:10/0 lens 488/0 e 0 to 0 dl 1782224320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782224309.071487:0:11906:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96eabf846a00 with x1868797312075776 ext(0->4095) 00002000:00010000:2.0:1782224309.071510:0:11906:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96eabf846a00 00000100:00100000:2.0:1782224309.071540:0:11906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:2.0:1782224309.071551:0:11906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2348:x1868797312075776:12345-192.168.202.7@tcp:3:cat.0 00000100:00100000:2.0:1782224309.071776:0:11906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+8:2348:x1868797312075776:12345-192.168.202.7@tcp:3:cat.0 Request processed in 226us (2970us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1782224309.071784:0:11906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00002000:00100000:2.0:1782224309.071791:0:11906:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff96eabf846a00 x1868797312075776/t0(0) o3->3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39@192.168.202.7@tcp:10/0 lens 488/4536 e 0 to 0 dl 1782224320 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782224309.071801:0:11906:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96eabf846a00 with x1868797312075776 ext(0->4095) 00002000:00010000:2.0:1782224309.071804:0:11906:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96eabf846a00 00000040:00080000:2.0:1782224309.909109:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782224309.909122:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782224309.909161:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1782224309.909169:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1782224309.940136:0:6608:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:0.0:1782224309.973782:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782224310.962081:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:1.0:1782224310.962113:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1782224310.995566:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000020:00080000:1.0:1782224310.995604:0:5808:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96eabfbcd300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1782224310.995610:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff96eabc8ad600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96eabfbcd0c0 00000020:00080000:1.0:1782224310.995729:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff96eabc8ade00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96eabc89dc00 00000020:00080000:1.0:1782224310.995778:0:5808:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1782224310.995790:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:1.0:1782224310.995809:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1782224310.996734:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1782224310.997069:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1782224310.997132:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224312.021145:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224312.404540:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782224312.404573:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333030144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782224312.404683:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224312.405156:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333030144 00000100:00100000:3.0:1782224312.405168:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333030144 00000100:00100000:3.0:1782224312.405390:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782224312.405403:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333030144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782224312.405457:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224312.405534:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333030144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224312.405542:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782224312.405890:0:3303:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1782224312.405897:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96e986bbd180, transno 4294967310 00000100:00100000:1.0:1782224312.405925:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333030144:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782224312.406369:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782224313.044592:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224313.428548:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333030656:0@lo:400:kworker.0 00000100:00100000:2.0:1782224313.428648:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224313.428892:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797333030272:0@lo:400:kworker.0 00000100:00100000:0.0:1782224313.428935:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224313.428992:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83279880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333030528:0@lo:400:kworker.0 00000100:00100000:3.0:1782224313.429073:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224313.429144:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797333030400:0@lo:400:kworker.0 00000100:00100000:1.0:1782224313.429180:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224313.429610:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333030656 00000100:00100000:0.0:1782224313.429637:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333030656 00000100:00100000:0.0:1782224313.430830:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782224313.430854:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333030656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224313.430979:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333030656:12345-0@lo:400:kworker.0 Request processed in 136us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224313.430987:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782224313.436580:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333030272 00000100:00100000:0.0:1782224313.436605:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333030272 00000100:00100000:2.0:1782224313.438660:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797333030784:0@lo:400:kworker.0 00000100:00100000:2.0:1782224313.438791:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224313.438892:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333030528 00000100:00100000:2.0:1782224313.438902:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333030528 00000100:00100000:2.0:1782224313.439035:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333030400 00000100:00100000:2.0:1782224313.439039:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333030400 00000100:00100000:2.0:1782224313.439056:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333030784 00000100:00100000:2.0:1782224313.439058:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333030784 00000100:00100000:2.0:1782224313.439077:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1782224313.439086:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333030528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224313.439164:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333030528:12345-0@lo:400:kworker.0 Request processed in 78us (10100us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224313.439172:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1782224313.439194:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1782224313.439200:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797333030400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224313.439230:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797333030400:12345-0@lo:400:kworker.0 Request processed in 30us (10049us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224313.439236:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1782224313.439248:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1782224313.439254:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797333030784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224313.439297:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797333030784:12345-0@lo:400:kworker.0 Request processed in 43us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224313.439303:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1782224313.439321:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224313.439368:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333030656:0@lo:400:kworker.0 00000100:00100000:2.0:1782224313.439407:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797333030784:0@lo:400:kworker.0 00000100:00100000:3.0:1782224313.440644:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83279880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333030528:0@lo:400:kworker.0 00000100:00100000:0.0:1782224313.443457:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1782224313.443489:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797333030272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224313.443632:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797333030272:12345-0@lo:400:kworker.0 Request processed in 162us (14694us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224313.443640:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1782224313.444603:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797333030272:0@lo:400:kworker.0 00000100:00100000:1.0:1782224313.445947:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797333030400:0@lo:400:kworker.0 00000100:00100000:1.0:1782224313.445968:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333030912:0@lo:400:kworker.0 00000100:00100000:1.0:1782224313.446085:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224313.446460:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333030912 00000100:00100000:3.0:1782224313.446469:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333030912 00000100:00100000:3.0:1782224313.446553:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782224313.446564:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabd0f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333030912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224313.446636:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabd0f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333030912:12345-0@lo:400:kworker.0 Request processed in 72us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224313.446644:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1782224313.446850:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782224313.446880:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1782224313.446887:0:3306:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1782224313.446909:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333030912:0@lo:400:kworker.0 00000100:00100000:3.0:1782224313.869566:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224313.869629:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224313.869673:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224313.869712:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224313.869765:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224313.869821:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312076032 00000100:00100000:3.0:1782224313.869833:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312076032 00000100:00100000:3.0:1782224313.869905:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312076416 00000100:00100000:3.0:1782224313.869909:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312076416 00000100:00100000:3.0:1782224313.869936:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 169 00000100:00100000:3.0:1782224313.869948:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:2346:x1868797312076032:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224313.869972:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312075904 00000100:00100000:1.0:1782224313.869979:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312075904 00000100:00100000:1.0:1782224313.870046:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 301 00000100:00100000:1.0:1782224313.870056:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2346:x1868797312075904:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224313.870083:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:2346:x1868797312076032:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 135us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224313.870091:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 169 00000100:00100000:1.0:1782224313.870098:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2346:x1868797312075904:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 39us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224313.870117:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 170 00000100:00100000:1.0:1782224313.870123:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 301 00000100:00100000:3.0:1782224313.870128:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e986bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2346:x1868797312076416:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224313.870163:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e986bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2346:x1868797312076416:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 38us (398us total) trans 0 rc 0/0 00000100:00080000:1.0:1782224313.870164:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224313.870173:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 170 00000100:00100000:0.0:1782224313.870344:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312076288 00000100:00100000:0.0:1782224313.870349:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312076288 00000100:00100000:0.0:1782224313.870405:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312076160 00000100:00100000:0.0:1782224313.870408:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312076160 00000100:00100000:0.0:1782224313.870434:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 100 00000100:00100000:0.0:1782224313.870441:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312076288:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224313.870481:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312076288:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 41us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224313.870489:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 100 00000100:00100000:0.0:1782224313.870503:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 101 00000100:00100000:0.0:1782224313.870509:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83279880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2346:x1868797312076160:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224313.870537:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83279880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2346:x1868797312076160:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 28us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224313.870555:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 101 00000100:00080000:1.0:1782224313.870722:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782224313.870726:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782224313.941987:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eac1d8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333031040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782224313.942156:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224313.942354:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333031040 00000100:00100000:2.0:1782224313.942365:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333031040 00000100:00100000:2.0:1782224313.942435:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782224313.942445:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc01e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333031040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782224313.942515:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224313.942576:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc01e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333031040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224313.942584:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782224313.942753:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eac1d8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333031040:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782224314.073724:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224315.092191:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224315.488984:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224315.489313:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312076544 00000100:00100000:2.0:1782224315.489328:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312076544 00000100:00100000:2.0:1782224315.489442:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 238 00000100:00100000:2.0:1782224315.489457:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e9879d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:11268:x1868797312076544:12345-192.168.202.7@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1782224315.489761:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e9879d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:11268:x1868797312076544:12345-192.168.202.7@tcp:60:lhsmtool_posix.0 Request processed in 308us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224315.489771:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 238 00000100:00080000:1.0:1782224315.489909:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224315.494332:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224315.495571:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312076800 00000100:00100000:0.0:1782224315.495588:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312076800 00000100:00100000:0.0:1782224315.495674:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 65 00000100:00100000:0.0:1782224315.495685:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:11268:x1868797312076800:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782224315.496387:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+19:11268:x1868797312076800:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 700us (2069us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1782224315.496399:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 65 00000100:00100000:0.0:1782224315.922325:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224315.923050:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312076928 00000100:00100000:2.0:1782224315.923062:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312076928 00000100:00100000:2.0:1782224315.923143:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 239 00000100:00100000:2.0:1782224315.923156:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fff0e469-4c8f-4b03-af7c-046a658bf816+5:12076:x1868797312076928:12345-192.168.202.7@tcp:101:lsof.0 00010000:00010000:2.0:1782224315.923185:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224315.923214:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b1658c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51920 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224315.923311:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b1658ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224315.923327:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b1658ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224315.923338:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b1658ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224315.923673:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782224315.923677:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224315.923744:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b1658ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224315.923769:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaba00/0xcfd8b3ae4b1658c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51920 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224315.923788:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b1658ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51920 expref: 6 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224315.923797:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96eaa7d65200) 00010000:00010000:2.0:1782224315.923801:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782224315.923805:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbabe00, rc 0) 00000100:00100000:2.0:1782224315.923879:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fff0e469-4c8f-4b03-af7c-046a658bf816+6:12076:x1868797312076928:12345-192.168.202.7@tcp:101:lsof.0 Request processed in 727us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224315.923887:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 239 00000100:00080000:1.0:1782224315.924051:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1782224316.041446:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1782224316.041476:0:5808:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1782224316.041674:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1782224316.041691:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1782224316.116389:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224317.140239:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224317.524691:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782224317.524723:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333031168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782224317.524823:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224317.524963:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333031168 00000100:00100000:2.0:1782224317.524975:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333031168 00000100:00100000:2.0:1782224317.525079:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782224317.525091:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333031168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782224317.525146:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224317.525201:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333031168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224317.525231:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1782224317.525361:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782224317.525406:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333031168:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782224318.164594:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224318.548759:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333031680:0@lo:400:kworker.0 00000100:00100000:0.0:1782224318.548842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224318.548925:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782224318.548930:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797333031552:0@lo:400:kworker.0 00000100:00100000:0.0:1782224318.548953:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224318.549195:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333031680 00000100:00100000:1.0:1782224318.549214:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333031680 00000100:00100000:1.0:1782224318.549284:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782224318.549294:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333031680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224318.549354:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333031680:12345-0@lo:400:kworker.0 Request processed in 62us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224318.549361:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782224318.549574:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333031680:0@lo:400:kworker.0 00000100:00100000:2.0:1782224318.549711:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797333031424:0@lo:400:kworker.0 00000100:00100000:2.0:1782224318.549762:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224318.549793:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333031936:0@lo:400:kworker.0 00000100:00100000:2.0:1782224318.549825:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224318.549857:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782224318.549862:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eac1d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797333031296:0@lo:400:kworker.0 00000100:00100000:2.0:1782224318.549889:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224318.549908:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333031808:0@lo:400:kworker.0 00000100:00100000:2.0:1782224318.549929:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224318.550117:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333031552 00000100:00100000:0.0:1782224318.550123:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333031552 00000100:00100000:0.0:1782224318.550169:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333031424 00000100:00100000:0.0:1782224318.550172:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333031424 00000100:00100000:0.0:1782224318.550182:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333031808 00000100:00100000:0.0:1782224318.550184:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333031808 00000100:00100000:0.0:1782224318.550222:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1782224318.550228:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797333031552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224318.550283:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868797333031552:12345-0@lo:400:kworker.0 Request processed in 54us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224318.550289:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1782224318.550301:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1782224318.550306:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797333031424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224318.550332:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797333031424:12345-0@lo:400:kworker.0 Request processed in 26us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224318.550337:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1782224318.550345:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1782224318.550350:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797333031808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224318.550373:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797333031808:12345-0@lo:400:kworker.0 Request processed in 23us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224318.550379:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1782224318.550395:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333031296 00000100:00100000:0.0:1782224318.550398:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333031296 00000100:00100000:0.0:1782224318.550419:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1782224318.550424:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797333031296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224318.550449:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b33607d9-62cb-4729-8187-59883763158a+19:3306:x1868797333031296:12345-0@lo:400:kworker.0 Request processed in 26us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224318.550455:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1782224318.550490:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eac1d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797333031296:0@lo:400:kworker.0 00000100:00100000:0.0:1782224318.550500:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333031808:0@lo:400:kworker.0 00000100:00100000:0.0:1782224318.550508:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797333031424:0@lo:400:kworker.0 00000100:00100000:0.0:1782224318.550542:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1868797333031552:0@lo:400:kworker.0 00000100:00100000:1.0:1782224318.550714:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333031936 00000100:00100000:1.0:1782224318.550718:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333031936 00000100:00100000:1.0:1782224318.550757:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782224318.550764:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eac1d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333031936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224318.550798:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eac1d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333031936:12345-0@lo:400:kworker.0 Request processed in 35us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224318.550803:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782224318.551110:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333031936:0@lo:400:kworker.0 00000100:00080000:2.0:1782224318.551284:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782224318.551290:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224318.994701:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224318.994745:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224318.994798:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224318.994822:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224318.994847:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224318.994879:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312077568 00000100:00100000:3.0:1782224318.994890:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312077568 00000100:00100000:3.0:1782224318.994942:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312077184 00000100:00100000:3.0:1782224318.994949:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312077184 00000100:00100000:3.0:1782224318.994968:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 174 00000100:00100000:3.0:1782224318.994978:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+6:2346:x1868797312077568:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224318.995092:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fff0e469-4c8f-4b03-af7c-046a658bf816+6:2346:x1868797312077568:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 114us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224318.995100:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 174 00000100:00100000:3.0:1782224318.995117:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 175 00000100:00100000:3.0:1782224318.995123:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:2346:x1868797312077184:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224318.995147:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:2346:x1868797312077184:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 25us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224318.995153:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 175 00000100:00080000:3.0:1782224318.995273:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224318.995348:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312077056 00000100:00100000:1.0:1782224318.995353:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312077056 00000100:00100000:1.0:1782224318.995398:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 303 00000100:00100000:1.0:1782224318.995406:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2346:x1868797312077056:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224318.995444:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2346:x1868797312077056:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 40us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224318.995450:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 303 00000100:00100000:2.0:1782224318.995762:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312077312 00000100:00100000:2.0:1782224318.995767:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312077312 00000100:00100000:2.0:1782224318.995799:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312077440 00000100:00100000:2.0:1782224318.995801:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312077440 00000100:00100000:2.0:1782224318.995822:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 104 00000100:00100000:2.0:1782224318.995828:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2346:x1868797312077312:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224318.995864:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2346:x1868797312077312:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 36us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224318.995870:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 104 00000100:00100000:2.0:1782224318.995883:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 105 00000100:00100000:2.0:1782224318.995889:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312077440:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224318.995912:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2346:x1868797312077440:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 23us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224318.995930:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 105 00000100:00080000:2.0:1782224318.995946:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782224318.995949:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782224319.060376:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabc89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333032064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782224319.060449:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224319.060613:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333032064 00000100:00100000:2.0:1782224319.060621:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333032064 00000100:00100000:2.0:1782224319.060672:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782224319.060680:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333032064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782224319.060718:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224319.060771:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333032064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224319.060779:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782224319.060989:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabc89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333032064:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1782224319.125251:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782224319.125262:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782224319.127439:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1782224319.127453:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1782224319.188762:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224320.214498:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782224320.416449:0:12660:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:18:38 (1782224318) 00010000:00010000:0.0:1782224321.240256:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224322.260331:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224322.644183:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782224322.644238:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333032192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782224322.644320:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224322.644399:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333032192 00000100:00100000:1.0:1782224322.644408:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333032192 00000100:00100000:1.0:1782224322.644472:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782224322.644483:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333032192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782224322.644541:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224322.644589:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333032192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224322.644598:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1782224322.644623:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782224322.644669:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333032192:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782224323.284442:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224323.668562:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333032576:0@lo:400:kworker.0 00000100:00100000:2.0:1782224323.668639:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224323.668710:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224323.668717:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333032704:0@lo:400:kworker.0 00000100:00100000:2.0:1782224323.668744:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224323.668777:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333032704 00000100:00100000:2.0:1782224323.668784:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333032704 00000100:00100000:2.0:1782224323.668837:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782224323.668846:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc89bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333032704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224323.668911:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc89bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333032704:12345-0@lo:400:kworker.0 Request processed in 64us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224323.668918:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782224323.668959:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333032704:0@lo:400:kworker.0 00000100:00100000:3.0:1782224323.669240:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797333032320:0@lo:400:kworker.0 00000100:00100000:3.0:1782224323.669278:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224323.669311:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797333032832:0@lo:400:kworker.0 00000100:00100000:3.0:1782224323.669332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224323.669348:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782224323.669352:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333032448:0@lo:400:kworker.0 00000100:00100000:3.0:1782224323.669370:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224323.669383:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333032960:0@lo:400:kworker.0 00000100:00100000:3.0:1782224323.669418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224323.669444:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333032576 00000100:00100000:3.0:1782224323.669448:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333032576 00000100:00100000:3.0:1782224323.669482:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333032832 00000100:00100000:3.0:1782224323.669485:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333032832 00000100:00100000:3.0:1782224323.669496:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333032448 00000100:00100000:3.0:1782224323.669498:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333032448 00000100:00100000:3.0:1782224323.669510:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1782224323.669516:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333032576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224323.669550:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333032576:12345-0@lo:400:kworker.0 Request processed in 34us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224323.669556:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1782224323.669568:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1782224323.669573:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797333032832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224323.669599:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797333032832:12345-0@lo:400:kworker.0 Request processed in 26us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224323.669605:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1782224323.669615:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1782224323.669620:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabccb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333032448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224323.669643:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabccb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333032448:12345-0@lo:400:kworker.0 Request processed in 24us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224323.669649:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:3.0:1782224323.669667:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224323.669685:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333032448:0@lo:400:kworker.0 00000100:00100000:3.0:1782224323.669695:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797333032832:0@lo:400:kworker.0 00000100:00100000:3.0:1782224323.669717:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333032576:0@lo:400:kworker.0 00000100:00100000:0.0:1782224323.669921:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333032960 00000100:00100000:0.0:1782224323.669925:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333032960 00000100:00100000:0.0:1782224323.669967:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782224323.669974:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333032960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224323.670064:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333032960:12345-0@lo:400:kworker.0 Request processed in 90us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224323.670072:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782224323.670104:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333032960:0@lo:400:kworker.0 00000100:00100000:2.0:1782224323.670685:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333032320 00000100:00100000:2.0:1782224323.670700:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333032320 00000100:00100000:2.0:1782224323.670736:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1782224323.670744:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797333032320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224323.670794:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797333032320:12345-0@lo:400:kworker.0 Request processed in 51us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224323.670800:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:3.0:1782224323.670965:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782224323.671046:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797333032320:0@lo:400:kworker.0 00000100:00100000:3.0:1782224324.112565:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224324.112618:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224324.112651:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224324.112676:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224324.112737:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224324.112764:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312077824 00000100:00100000:3.0:1782224324.112774:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312077824 00000100:00100000:3.0:1782224324.112832:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312078208 00000100:00100000:3.0:1782224324.112836:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312078208 00000100:00100000:3.0:1782224324.112878:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 179 00000100:00100000:3.0:1782224324.112887:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:2348:x1868797312077824:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224324.113103:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312077952 00000100:00100000:2.0:1782224324.113108:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312077952 00000100:00100000:2.0:1782224324.113142:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312078080 00000100:00100000:2.0:1782224324.113145:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312078080 00000100:00100000:2.0:1782224324.113170:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 108 00000100:00100000:2.0:1782224324.113177:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2349:x1868797312077952:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224324.113260:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2349:x1868797312077952:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 83us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224324.113268:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 108 00000100:00100000:2.0:1782224324.113285:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 109 00000100:00100000:2.0:1782224324.113292:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2348:x1868797312078080:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224324.113332:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2348:x1868797312078080:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 40us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224324.113338:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 109 00000100:00100000:2.0:1782224324.113496:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 180 00000100:00100000:2.0:1782224324.113504:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf5a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fff0e469-4c8f-4b03-af7c-046a658bf816+6:2349:x1868797312078208:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224324.113536:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf5a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fff0e469-4c8f-4b03-af7c-046a658bf816+6:2349:x1868797312078208:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 34us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224324.113542:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 180 00000100:00080000:2.0:1782224324.113571:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782224324.113575:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782224324.113578:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224324.114153:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:2348:x1868797312077824:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 1264us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224324.114163:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 179 00000100:00100000:1.0:1782224324.114337:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312077696 00000100:00100000:1.0:1782224324.114343:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312077696 00000100:00100000:1.0:1782224324.114384:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 305 00000100:00100000:1.0:1782224324.114392:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2349:x1868797312077696:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224324.114422:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2349:x1868797312077696:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 32us (1804us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224324.114428:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 305 00000100:00100000:3.0:1782224324.180336:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabba6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333033088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782224324.180413:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224324.180712:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333033088 00000100:00100000:1.0:1782224324.180720:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333033088 00000100:00100000:1.0:1782224324.180825:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782224324.180835:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333033088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782224324.180873:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224324.180930:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333033088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224324.180938:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782224324.181009:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabba6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333033088:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782224324.313059:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224325.332248:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224325.436550:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224325.439152:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312078464 00000100:00100000:0.0:1782224325.439220:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312078464 00000100:00100000:0.0:1782224325.439310:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 66 00000100:00100000:0.0:1782224325.439321:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+18:12297:x1868797312078464:12345-192.168.202.7@tcp:35:umount.0 00000100:00100000:0.0:1782224325.439930:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+19:12297:x1868797312078464:12345-192.168.202.7@tcp:35:umount.0 Request processed in 608us (3387us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1782224325.439939:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 66 00000100:00100000:3.0:1782224325.442646:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224325.443135:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312078720 00000100:00100000:0.0:1782224325.443144:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312078720 00000100:00100000:0.0:1782224325.443203:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 67 00000100:00100000:0.0:1782224325.443215:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+19:12297:x1868797312078720:12345-192.168.202.7@tcp:35:umount.0 00000100:00100000:0.0:1782224325.443640:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+20:12297:x1868797312078720:12345-192.168.202.7@tcp:35:umount.0 Request processed in 426us (999us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1782224325.443649:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 67 00000100:00100000:3.0:1782224325.445841:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224325.446009:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312078976 00000100:00100000:2.0:1782224325.446150:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312078976 00000100:00100000:2.0:1782224325.446255:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 68 00000100:00100000:2.0:1782224325.446267:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea9c44c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+20:12297:x1868797312078976:12345-192.168.202.7@tcp:35:umount.0 00000100:00100000:2.0:1782224325.446800:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea9c44c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+21:12297:x1868797312078976:12345-192.168.202.7@tcp:35:umount.0 Request processed in 534us (967us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1782224325.446810:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 68 00000100:00100000:2.0:1782224325.448643:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224325.448778:0:11907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312079232 00000100:00100000:0.0:1782224325.448786:0:11907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312079232 00000100:00100000:0.0:1782224325.448882:0:11907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:0.0:1782224325.448892:0:11907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabba6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+21:12297:x1868797312079232:12345-192.168.202.7@tcp:35:umount.0 00000100:00100000:0.0:1782224325.449249:0:11907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabba6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+22:12297:x1868797312079232:12345-192.168.202.7@tcp:35:umount.0 Request processed in 357us (611us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1782224325.449257:0:11907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:0.0:1782224325.451808:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224325.451900:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224325.452282:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224325.452341:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312079360 00000100:00100000:1.0:1782224325.452350:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312079360 00000100:00100000:1.0:1782224325.452410:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312079616 00000100:00100000:1.0:1782224325.452414:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312079616 00000100:00100000:1.0:1782224325.452439:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:1.0:1782224325.452448:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4fff53da-03fa-4566-9f6c-b379e18824a7+14:2348:x1868797312079360:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782224325.452463:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224325.452484:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabbb86a00/0xcfd8b3ae4b164942 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514ab expref: 14 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224325.452511:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224325.452560:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4fff53da-03fa-4566-9f6c-b379e18824a7+13:2348:x1868797312079360:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 113us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224325.452569:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:1.0:1782224325.452588:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:1.0:1782224325.452594:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8757ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4fff53da-03fa-4566-9f6c-b379e18824a7+12:2348:x1868797312079616:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782224325.452601:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224325.452610:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea99876a00/0xcfd8b3ae4b164b56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51576 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224325.452632:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224325.452650:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8757ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4fff53da-03fa-4566-9f6c-b379e18824a7+11:2348:x1868797312079616:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 56us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224325.452656:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:1.0:1782224325.453992:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312079488 00000100:00100000:1.0:1782224325.454002:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312079488 00000100:00100000:1.0:1782224325.454228:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:1.0:1782224325.454238:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4fff53da-03fa-4566-9f6c-b379e18824a7+11:2348:x1868797312079488:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782224325.454250:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224325.454264:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90675400/0xcfd8b3ae4b1648a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51473 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224325.454280:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224325.454333:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2348:x1868797312079488:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 96us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224325.454341:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:1.0:1782224325.456299:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224325.456384:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312080000 00000100:00100000:2.0:1782224325.456392:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312080000 00000100:00100000:2.0:1782224325.456484:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 72 00000100:00100000:2.0:1782224325.456496:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2345:x1868797312080000:12345-192.168.202.7@tcp:9:umount.0 00000020:00000080:2.0:1782224325.456536:0:6584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b164e7b 00000020:00010000:2.0:1782224325.456544:0:6584:0:(genops.c:1942:obd_stale_export_put()) Put export ffff96ea85d62800: total 0 00000100:00080000:2.0:1782224325.456549:0:6584:0:(import.c:65:import_set_state_nolock()) ffff96ea85d65000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782224325.456598:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1782224325.456888:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2345:x1868797312080000:12345-192.168.202.7@tcp:9:umount.0 Request processed in 393us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224325.456896:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 72 00000020:00010000:1.0:1782224325.456944:0:5774:0:(genops.c:1928:obd_stale_export_get()) Get export ffff96ea85d62800: total 0 00010000:00010000:1.0:1782224325.456984:0:5774:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff96ea85d62800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1782224325.457075:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b1658bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51919 expref: 4 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224325.457111:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000551c5146/0xcfd8b3ae4b16521e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5174b expref: 3 pid: 6715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224325.457126:0:5774:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff96ea85d62800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1782224325.457157:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224325.457159:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224325.457161:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224325.462516:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224325.462590:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312080128 00000100:00100000:3.0:1782224325.462599:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312080128 00000100:00100000:3.0:1782224325.462655:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 73 00000100:00100000:3.0:1782224325.462664:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+5:2345:x1868797312080128:12345-192.168.202.7@tcp:9:umount.0 00000020:00000080:3.0:1782224325.462694:0:6585:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b164c1a 00000100:00080000:3.0:1782224325.462714:0:6585:0:(import.c:65:import_set_state_nolock()) ffff96ea83552800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782224325.462757:0:6585:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1782224325.463051:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+2:2345:x1868797312080128:12345-192.168.202.7@tcp:9:umount.0 Request processed in 350us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224325.463073:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 73 00010000:00010000:1.0:1782224325.463198:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224325.474803:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224325.474925:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312081152 00000100:00100000:2.0:1782224325.474937:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312081152 00000100:00100000:2.0:1782224325.475254:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 240 00000100:00100000:2.0:1782224325.475279:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+22:2345:x1868797312081152:12345-192.168.202.7@tcp:39:umount.0 00000020:00000080:2.0:1782224325.475315:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b1648b6 00000020:00010000:2.0:1782224325.475330:0:6605:0:(genops.c:1942:obd_stale_export_put()) Put export ffff96eabf839800: total 0 00000100:00080000:2.0:1782224325.475334:0:6605:0:(import.c:65:import_set_state_nolock()) ffff96eabf83d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782224325.475354:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1782224325.475792:0:5774:0:(genops.c:1928:obd_stale_export_get()) Get export ffff96eabf839800: total 0 00010000:00010000:0.0:1782224325.475796:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224325.475843:0:5774:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff96eabf839800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1782224325.475871:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:0.0:1782224325.475874:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782224325.475883:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b16529c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5176e expref: 21 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224325.475902:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:0.0:1782224325.475904:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782224325.475908:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55600/0xcfd8b3ae4b1650ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a516fe expref: 20 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224325.475920:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:0.0:1782224325.475922:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782224325.475925:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b164bf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a515a0 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224325.475941:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:0.0:1782224325.475943:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782224325.475946:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55800/0xcfd8b3ae4b16579d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a518cc expref: 18 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224325.475958:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96ea87df7c00) 00010000:00010000:0.0:1782224325.475961:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224325.475964:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b164b9c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5158b expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224325.475983:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:0.0:1782224325.475985:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782224325.475995:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaaa00/0xcfd8b3ae4b165209 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51744 expref: 16 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224325.476010:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:0.0:1782224325.476042:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782224325.476047:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b16587d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51904 expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224325.476062:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96eaa7d65200) 00010000:00010000:0.0:1782224325.476064:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782224325.476068:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a74000/0xcfd8b3ae4b165280 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51767 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224325.476079:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96eaa7d65b00) 00010000:00010000:0.0:1782224325.476082:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782224325.476085:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b1658a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51912 expref: 13 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224325.476099:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96ea87df7800) 00010000:00010000:0.0:1782224325.476102:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782224325.476105:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b1651df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51736 expref: 12 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224325.476121:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96ea8508f000) 00010000:00010000:0.0:1782224325.476124:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782224325.476127:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674e00/0xcfd8b3ae4b16557b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51840 expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224325.476142:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96ea87df7000) 00010000:00010000:0.0:1782224325.476150:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782224325.476155:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea99877a00/0xcfd8b3ae4b164edd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51672 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224325.476184:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96eaa7d65800) 00010000:00010000:0.0:1782224325.476187:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782224325.476191:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea88a75600/0xcfd8b3ae4b164b80 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51584 expref: 9 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224325.476205:0:5774:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff96eabf839800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1782224325.476217:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224325.476219:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224325.476221:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224325.476347:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39+7:2345:x1868797312081152:12345-192.168.202.7@tcp:39:umount.0 Request processed in 1070us (1552us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1782224325.476357:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 240 00000001:00080000:0.0:1782224326.265372:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:0.0:1782224326.265395:0:5808:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 00000001:00080000:0.0:1782224326.265401:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1782224326.265407:0:5808:0:(genops.c:906:class_export_put()) final put ffff96eabf839800/3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 00000020:00000080:2.0:1782224326.265566:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabf839800/3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 for lustre-MDT0000 00000020:00000080:2.0:1782224326.265627:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96eabf83d800 for lustre-MDT0000 00000001:00100000:1.0:1782224326.286376:0:7486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 00000020:00000080:1.0:1782224326.286384:0:7486:0:(genops.c:906:class_export_put()) final put ffff96ea85d62800/3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 00000020:00000080:2.0:1782224326.286485:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96ea85d62800/3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 for lustre-OST0001 00000020:00000080:2.0:1782224326.286548:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96ea85d65000 for lustre-OST0001 00010000:00010000:1.0:1782224326.356370:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224327.382106:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224327.646877:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224327.646921:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224327.647071:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312081280 00000100:00100000:0.0:1782224327.647081:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312081280 00000100:00100000:0.0:1782224327.647159:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312081536 00000100:00100000:0.0:1782224327.647163:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312081536 00000100:00100000:0.0:1782224327.647194:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:0.0:1782224327.647204:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf795f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4fff53da-03fa-4566-9f6c-b379e18824a7+11:2347:x1868797312081280:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224327.647223:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224327.647243:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabbb87800/0xcfd8b3ae4b164988 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514c0 expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224327.647261:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224327.647331:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf795f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4fff53da-03fa-4566-9f6c-b379e18824a7+10:2347:x1868797312081280:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 127us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224327.647339:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:0.0:1782224327.647357:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:0.0:1782224327.647363:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf796300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4fff53da-03fa-4566-9f6c-b379e18824a7+9:2347:x1868797312081536:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224327.647372:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224327.647380:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea88a75800/0xcfd8b3ae4b164b25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5156f expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224327.647390:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224327.647408:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf796300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4fff53da-03fa-4566-9f6c-b379e18824a7+8:2347:x1868797312081536:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 45us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224327.647414:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:1.0:1782224327.647643:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224327.647848:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312081408 00000100:00100000:0.0:1782224327.647854:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312081408 00000100:00100000:0.0:1782224327.647878:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00100000:0.0:1782224327.647885:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4fff53da-03fa-4566-9f6c-b379e18824a7+8:2347:x1868797312081408:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224327.647894:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224327.647904:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea99876e00/0xcfd8b3ae4b16498f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514ea expref: 8 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224327.647914:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224327.647937:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4fff53da-03fa-4566-9f6c-b379e18824a7+7:2347:x1868797312081408:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 52us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224327.647957:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00100000:1.0:1782224327.663968:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224327.664113:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312081792 00000100:00100000:3.0:1782224327.664124:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312081792 00000100:00100000:3.0:1782224327.664213:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 241 00000100:00100000:3.0:1782224327.664225:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+6:2345:x1868797312081792:12345-192.168.202.7@tcp:39:umount.0 00000020:00000080:3.0:1782224327.664266:0:5788:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b16499d 00000020:00010000:3.0:1782224327.664275:0:5788:0:(genops.c:1942:obd_stale_export_put()) Put export ffff96eaa7f72800: total 0 00000100:00080000:3.0:1782224327.664279:0:5788:0:(import.c:65:import_set_state_nolock()) ffff96eaa7f75000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782224327.664308:0:5788:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1782224327.664730:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fff0e469-4c8f-4b03-af7c-046a658bf816+5:2345:x1868797312081792:12345-192.168.202.7@tcp:39:umount.0 Request processed in 507us (771us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1782224327.664739:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 241 00000020:00010000:1.0:1782224327.665429:0:5773:0:(genops.c:1928:obd_stale_export_get()) Get export ffff96eaa7f72800: total 0 00010000:00010000:1.0:1782224327.665490:0:5773:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff96eaa7f72800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782224327.665522:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96eaa7d65200) 00010000:00010000:1.0:1782224327.665526:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782224327.665535:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbabe00/0xcfd8b3ae4b1658ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51920 expref: 4 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224327.665557:0:5773:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff96eaa7f72800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1782224327.665568:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224327.665570:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224327.665572:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782224327.665759:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782224327.695365:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224327.695572:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312082048 00000100:00100000:1.0:1782224327.695582:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312082048 00000100:00100000:1.0:1782224327.695634:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 306 00000100:00100000:1.0:1782224327.695643:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+7:2345:x1868797312082048:12345-192.168.202.7@tcp:251:umount.0 00000020:00000080:1.0:1782224327.696256:0:5781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b164893 00000020:00010000:1.0:1782224327.696265:0:5781:0:(genops.c:1942:obd_stale_export_put()) Put export ffff96eabf838000: total 0 00000100:00080000:1.0:1782224327.696271:0:5781:0:(import.c:65:import_set_state_nolock()) ffff96eabf839000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1782224327.696441:0:5774:0:(genops.c:1928:obd_stale_export_get()) Get export ffff96eabf838000: total 0 00010000:00010000:0.0:1782224327.696450:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224327.696507:0:5774:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff96eabf838000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782224327.696543:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabb611600/0xcfd8b3ae4b164949 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a514b2 expref: 3 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224327.696560:0:5774:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff96eabf838000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1782224327.696568:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224327.696570:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224327.696571:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224327.696611:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fff53da-03fa-4566-9f6c-b379e18824a7+1:2345:x1868797312082048:12345-192.168.202.7@tcp:251:umount.0 Request processed in 967us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224327.696619:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 306 00000020:00000080:1.0:1782224327.696632:0:5781:0:(genops.c:906:class_export_put()) final put ffff96eabf838000/4fff53da-03fa-4566-9f6c-b379e18824a7 00000020:00000080:3.0:1782224327.697334:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabf838000/4fff53da-03fa-4566-9f6c-b379e18824a7 for MGS 00000020:00000080:3.0:1782224327.697375:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96eabf839000 for MGS 00000100:00100000:0.0:1782224327.764259:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333033216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782224327.764350:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224327.764516:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333033216 00000100:00100000:3.0:1782224327.764525:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333033216 00000100:00100000:3.0:1782224327.764608:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782224327.764618:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333033216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782224327.764654:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782224327.764723:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782224327.771921:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333033216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7231us (7497us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224327.771936:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782224327.773218:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333033216:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782224328.409510:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224328.789743:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797333033344:0@lo:400:kworker.0 00000100:00100000:3.0:1782224328.789819:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224328.789867:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797333033856:0@lo:400:kworker.0 00000100:00100000:3.0:1782224328.789905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224328.789932:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782224328.789937:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333033472:0@lo:400:kworker.0 00000100:00100000:3.0:1782224328.789963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224328.789979:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333033984:0@lo:400:kworker.0 00000100:00100000:3.0:1782224328.790002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224328.790051:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333033728:0@lo:400:kworker.0 00000100:00100000:3.0:1782224328.790081:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224328.790105:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333033600:0@lo:400:kworker.0 00000100:00100000:3.0:1782224328.790117:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333033344 00000100:00100000:3.0:1782224328.790125:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333033344 00000100:00100000:3.0:1782224328.790186:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1782224328.790198:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea835df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797333033344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224328.790252:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea835df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797333033344:12345-0@lo:400:kworker.0 Request processed in 56us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224328.790259:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1782224328.790293:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333033856 00000100:00100000:3.0:1782224328.790297:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333033856 00000100:00100000:2.0:1782224328.790315:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224328.790353:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333033472 00000100:00100000:2.0:1782224328.790357:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333033472 00000100:00100000:2.0:1782224328.790382:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333033600 00000100:00100000:2.0:1782224328.790385:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333033600 00000100:00100000:2.0:1782224328.790400:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1782224328.790406:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797333033856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224328.790440:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797333033856:12345-0@lo:400:kworker.0 Request processed in 33us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224328.790446:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1782224328.790458:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1782224328.790463:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333033472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224328.790500:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333033472:12345-0@lo:400:kworker.0 Request processed in 36us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224328.790506:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1782224328.790519:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1782224328.790525:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333033600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224328.790555:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333033600:12345-0@lo:400:kworker.0 Request processed in 31us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224328.790560:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1782224328.790578:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333033984 00000100:00100000:2.0:1782224328.790581:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333033984 00000100:00100000:2.0:1782224328.790607:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333033728 00000100:00100000:2.0:1782224328.790610:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333033728 00000100:00100000:2.0:1782224328.790629:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782224328.790635:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333033984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224328.790745:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333033984:12345-0@lo:400:kworker.0 Request processed in 109us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224328.790751:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782224328.790764:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782224328.790770:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333033728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224328.790803:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333033728:12345-0@lo:400:kworker.0 Request processed in 34us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224328.790809:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782224328.790845:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333033600:0@lo:400:kworker.0 00000100:00100000:2.0:1782224328.790877:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333033728:0@lo:400:kworker.0 00000100:00100000:3.0:1782224328.791006:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333033472:0@lo:400:kworker.0 00000100:00100000:3.0:1782224328.791038:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333033984:0@lo:400:kworker.0 00000100:00100000:3.0:1782224328.791048:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797333033344:0@lo:400:kworker.0 00000100:00100000:3.0:1782224328.791059:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797333033856:0@lo:400:kworker.0 00000100:00080000:3.0:1782224328.791084:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782224328.791090:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782224329.300254:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333034112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782224329.300340:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224329.300480:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333034112 00000100:00100000:2.0:1782224329.300503:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333034112 00000100:00100000:2.0:1782224329.300574:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782224329.300585:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333034112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782224329.300624:0:6587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224329.300678:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333034112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224329.300686:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782224329.300780:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333034112:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1782224329.370233:0:11523:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782224329.370243:0:11523:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782224329.374504:0:11523:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1782224329.374536:0:11523:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1782224329.432366:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782224329.600931:0:12860:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1782224329.627224:0:12860:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1782224329.627283:0:12860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb610000/0xcfd8b3ae4b164918 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16491f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.627300:0:12860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb610000/0xcfd8b3ae4b164918 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b16491f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.627308:0:12860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb610000/0xcfd8b3ae4b164918 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b16491f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.627315:0:12860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff96eabb610000/0xcfd8b3ae4b164918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b16491f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.627334:0:12860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782224329.627340:0:12860:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1782224329.627365:0:12860:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782224329.627370:0:12860:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1782224329.627376:0:12860:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782224329.627403:0:12860:0:(import.c:65:import_set_state_nolock()) ffff96eabf38a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1782224329.627475:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782224329.627484:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabb610000/0xcfd8b3ae4b164918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b16491f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.627492:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabb610000 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:3.0:1782224329.627495:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabb610000/0xcfd8b3ae4b164918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b16491f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.627504:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabb610000/0xcfd8b3ae4b164918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfd8b3ae4b16491f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782224329.627511:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabb610000/0xcfd8b3ae4b164918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfd8b3ae4b16491f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224329.627517:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782224329.627519:0:5773:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1782224329.627521:0:5773:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1782224329.627550:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabb610000/0xcfd8b3ae4b164918 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfd8b3ae4b16491f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.627557:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782224329.627587:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabb610000/0xcfd8b3ae4b164918 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfd8b3ae4b16491f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.627594:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabb610000/0xcfd8b3ae4b164918 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfd8b3ae4b16491f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.627606:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224329.627608:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224329.627623:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224329.627643:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868797333034240:0@lo:39:umount.0 00000100:00100000:3.0:1782224329.627733:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224329.627804:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782224329.627813:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797333034368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782224329.627842:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224329.627879:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333034368 00000100:00100000:3.0:1782224329.627886:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333034368 00000100:00100000:3.0:1782224329.627932:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782224329.627941:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b33607d9-62cb-4729-8187-59883763158a+19:3303:x1868797333034368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782224329.627954:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224329.627971:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabbb87a00/0xcfd8b3ae4b16491f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfd8b3ae4b164918 expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.627984:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224329.628282:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b33607d9-62cb-4729-8187-59883763158a+18:3303:x1868797333034368:12345-0@lo:103:ldlm_bl.0 Request processed in 341us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224329.628291:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782224329.628333:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797333034368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782224329.629154:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333034240 00000100:00100000:3.0:1782224329.629163:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333034240 00000100:00100000:3.0:1782224329.629212:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1782224329.629222:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1868797333034240:12345-0@lo:39:umount.0 00000020:00000080:3.0:1782224329.629249:0:5788:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b1646a2 00000100:00080000:3.0:1782224329.629260:0:5788:0:(import.c:65:import_set_state_nolock()) ffff96eabf1a1000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1782224329.629333:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3302:x1868797333034240:12345-0@lo:39:umount.0 Request processed in 114us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224329.629359:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1782224329.629366:0:5788:0:(genops.c:906:class_export_put()) final put ffff96eabf1a0000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1782224329.629389:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782224329.629399:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabf1a0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1782224329.629446:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96eabf1a1000 for lustre-MDT0000 00000100:00080000:3.0:1782224329.629482:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96eabf38a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1782224329.629491:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868797333034240:0@lo:39:umount.0 00000100:00080000:1.0:1782224329.629555:0:12860:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782224329.629558:0:12860:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782224329.629563:0:12860:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1782224329.630479:0:12860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b164926 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16492d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.630510:0:12860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b164926 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b16492d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.630517:0:12860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b164926 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b16492d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.630523:0:12860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b164926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b16492d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.630544:0:12860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782224329.630551:0:12860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb87000/0xcfd8b3ae4b16484d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164854 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.630559:0:12860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb87000/0xcfd8b3ae4b16484d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164854 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.630565:0:12860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb87000/0xcfd8b3ae4b16484d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b164854 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.630571:0:12860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff96eabbb87000/0xcfd8b3ae4b16484d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b164854 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.630583:0:12860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782224329.630589:0:12860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b164b48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164b4f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.630595:0:12860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b164b48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164b4f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.630612:0:12860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b164b48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b164b4f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.630618:0:12860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b164b48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b164b4f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.630626:0:12860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1782224329.630632:0:12860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea99876000/0xcfd8b3ae4b164601 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164608 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.630638:0:12860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea99876000/0xcfd8b3ae4b164601 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164608 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.630644:0:12860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea99876000/0xcfd8b3ae4b164601 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b164608 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.630650:0:12860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff96ea99876000/0xcfd8b3ae4b164601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b164608 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224329.630656:0:12860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1782224329.630659:0:12860:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1782224329.630689:0:12860:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1782224329.630694:0:12860:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1782224329.630698:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782224329.630703:0:12860:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1782224329.630710:0:12860:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff96eabfc70000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782224329.630715:0:12860:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff96e984e3f000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782224329.630721:0:12860:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff96eaa7f72800 fff0e469-4c8f-4b03-af7c-046a658bf816 192.168.202.7@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782224329.630732:0:12860:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff96ea860dcd40) has exports, disconnecting them 00000020:00080000:1.0:1782224329.630737:0:12860:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96eabfc70000), last request at 1782224328 00000020:00000080:1.0:1782224329.630743:0:12860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b164815 00000100:00080000:1.0:1782224329.630763:0:12860:0:(import.c:65:import_set_state_nolock()) ffff96eabfc75800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1782224329.630812:0:12860:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96eabfc70000): rc 0 00000020:00000080:1.0:1782224329.630814:0:12860:0:(genops.c:906:class_export_put()) final put ffff96eabfc70000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1782224329.630822:0:12860:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96e984e3f000), last request at 1782224328 00000020:00000080:1.0:1782224329.630826:0:12860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b16474a 00000100:00080000:1.0:1782224329.630831:0:12860:0:(import.c:65:import_set_state_nolock()) ffff96e984e3c800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1782224329.630837:0:12860:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96e984e3f000): rc 0 00000020:00000080:1.0:1782224329.630839:0:12860:0:(genops.c:906:class_export_put()) final put ffff96e984e3f000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1782224329.630851:0:12860:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb3d501c43ae0 00000100:00080000:1.0:1782224329.630871:0:12860:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1782224329.630873:0:12860:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1782224329.630886:0:12860:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00080000:1.0:1782224329.630954:0:12860:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1782224329.630974:0:12860:0:(import.c:65:import_set_state_nolock()) ffff96ea9834f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1782224329.630987:0:12860:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1782224329.630989:0:12860:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1782224329.631002:0:12860:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00080000:1.0:1782224329.631091:0:12860:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1782224329.631100:0:12860:0:(import.c:65:import_set_state_nolock()) ffff96eaa4803800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1782224329.631127:0:12860:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff96ea860dcd40) has no exports 00000020:00000080:3.0:1782224329.631326:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabfc70000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1782224329.631374:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96e984e3f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1782224329.631408:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96eabfc75800 for lustre-MDT0000 00000020:00000080:3.0:1782224329.631412:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96e984e3c800 for lustre-MDT0000 00010000:00010000:3.0:1782224329.631423:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782224329.631428:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b164926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b16492d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631436:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabb611e00 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:3.0:1782224329.631440:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b164926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b16492d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631449:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b164926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfd8b3ae4b16492d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782224329.631456:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b164926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfd8b3ae4b16492d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224329.631461:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782224329.631464:0:5774:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1782224329.631466:0:5774:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1782224329.631499:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b164926 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfd8b3ae4b16492d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631507:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782224329.631525:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b164926 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfd8b3ae4b16492d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631533:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabb611e00/0xcfd8b3ae4b164926 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfd8b3ae4b16492d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631545:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782224329.631548:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabbb87000/0xcfd8b3ae4b16484d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b164854 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631554:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87000 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:3.0:1782224329.631557:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabbb87000/0xcfd8b3ae4b16484d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b164854 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631564:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabbb87000/0xcfd8b3ae4b16484d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfd8b3ae4b164854 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782224329.631569:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabbb87000/0xcfd8b3ae4b16484d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfd8b3ae4b164854 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224329.631574:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1782224329.631576:0:5774:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1782224329.631577:0:5774:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1782224329.631589:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabbb87000/0xcfd8b3ae4b16484d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfd8b3ae4b164854 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631595:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782224329.631601:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabbb87000/0xcfd8b3ae4b16484d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfd8b3ae4b164854 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631613:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabbb87000/0xcfd8b3ae4b16484d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfd8b3ae4b164854 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631625:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782224329.631628:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b164b48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b164b4f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631634:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675600 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:3.0:1782224329.631638:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b164b48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b164b4f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631658:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b164b48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfd8b3ae4b164b4f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782224329.631664:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b164b48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfd8b3ae4b164b4f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224329.631669:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1782224329.631671:0:5774:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1782224329.631673:0:5774:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1782224329.631687:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b164b48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfd8b3ae4b164b4f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631694:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782224329.631710:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b164b48 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfd8b3ae4b164b4f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631716:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b164b48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfd8b3ae4b164b4f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631737:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782224329.631741:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea99876000/0xcfd8b3ae4b164601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b164608 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631747:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea99876000 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:3.0:1782224329.631750:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea99876000/0xcfd8b3ae4b164601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b164608 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631757:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea99876000/0xcfd8b3ae4b164601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfd8b3ae4b164608 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782224329.631763:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea99876000/0xcfd8b3ae4b164601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfd8b3ae4b164608 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224329.631768:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1782224329.631770:0:5774:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1782224329.631771:0:5774:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1782224329.631785:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96ea99876000/0xcfd8b3ae4b164601 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfd8b3ae4b164608 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631791:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782224329.631797:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea99876000/0xcfd8b3ae4b164601 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfd8b3ae4b164608 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631802:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea99876000/0xcfd8b3ae4b164601 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfd8b3ae4b164608 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.631812:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224329.631814:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224329.631822:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224329.631839:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797333034752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782224329.631908:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224329.631953:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782224329.631959:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797333034880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782224329.631983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224329.632229:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797333035136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782224329.632259:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224329.632279:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782224329.632285:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797333035008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782224329.632306:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224329.632334:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333034752 00000100:00100000:3.0:1782224329.632341:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333034752 00000100:00100000:3.0:1782224329.632380:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333034880 00000100:00100000:3.0:1782224329.632382:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333034880 00000100:00100000:3.0:1782224329.632393:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333035136 00000100:00100000:3.0:1782224329.632396:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333035136 00000100:00100000:3.0:1782224329.632405:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333035008 00000100:00100000:3.0:1782224329.632407:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333035008 00000100:00100000:3.0:1782224329.632420:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782224329.632428:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+21:3305:x1868797333034752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782224329.632440:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224329.632452:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabbb87c00/0xcfd8b3ae4b16492d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfd8b3ae4b164926 expref: 21 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.632463:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224329.632491:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+20:3305:x1868797333034752:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224329.632497:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782224329.632521:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782224329.632527:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8757d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+19:3305:x1868797333034880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782224329.632534:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224329.632542:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabb611000/0xcfd8b3ae4b164854 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfd8b3ae4b16484d expref: 19 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.632553:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224329.632574:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8757d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+18:3305:x1868797333034880:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224329.632579:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782224329.632617:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782224329.632623:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+17:3304:x1868797333035136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782224329.632630:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224329.632637:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea99876400/0xcfd8b3ae4b164608 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfd8b3ae4b164601 expref: 17 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.633087:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224329.633123:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+16:3304:x1868797333035136:12345-0@lo:103:ldlm_bl.0 Request processed in 499us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224329.633130:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782224329.633156:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782224329.633163:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+15:3304:x1868797333035008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782224329.633173:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224329.633182:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea88a75400/0xcfd8b3ae4b164b4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfd8b3ae4b164b48 expref: 15 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224329.633190:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224329.633219:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b33607d9-62cb-4729-8187-59883763158a+14:3304:x1868797333035008:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224329.633225:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782224329.633273:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797333035008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782224329.633283:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b33607d9-62cb-4729-8187-59883763158a:3304:1868797333035136:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782224329.633306:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224329.633320:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797333034880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782224329.633329:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b33607d9-62cb-4729-8187-59883763158a:3305:1868797333034752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782224329.633353:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333034496:0@lo:9:umount.0 00000100:00100000:3.0:1782224329.633387:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224329.633409:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333034624:0@lo:9:umount.0 00000100:00100000:3.0:1782224329.633429:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224329.635293:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333034496 00000100:00100000:2.0:1782224329.635305:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333034496 00000100:00100000:2.0:1782224329.635357:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333034624 00000100:00100000:2.0:1782224329.635361:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333034624 00000100:00100000:2.0:1782224329.635383:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782224329.635392:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1868797333034496:12345-0@lo:9:umount.0 00000020:00000080:2.0:1782224329.635420:0:6584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b164797 00000100:00080000:2.0:1782224329.635428:0:6584:0:(import.c:65:import_set_state_nolock()) ffff96e9854d8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782224329.635463:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1782224329.635863:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3302:x1868797333034496:12345-0@lo:9:umount.0 Request processed in 470us (2473us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224329.635872:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782224329.635890:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782224329.635897:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1868797333034624:12345-0@lo:9:umount.0 00000020:00000080:2.0:1782224329.635911:0:6584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b16487e 00000100:00080000:2.0:1782224329.635917:0:6584:0:(import.c:65:import_set_state_nolock()) ffff96eabc600000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782224329.635939:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:3.0:1782224329.636241:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96ea9834f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1782224329.636257:0:3302:0:(osp_dev.c:1620:osp_import_event()) got disconnected 00000004:00080000:3.0:1782224329.636259:0:3302:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00100000:3.0:1782224329.636263:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333034496:0@lo:9:umount.0 00000100:00100000:2.0:1782224329.637129:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3302:x1868797333034624:12345-0@lo:9:umount.0 Request processed in 1228us (3694us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224329.637149:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1782224329.637183:0:5782:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782224329.637218:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224329.637224:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782224329.639085:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96eaa4803800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1782224329.639109:0:3302:0:(osp_dev.c:1620:osp_import_event()) got disconnected 00000004:00080000:1.0:1782224329.639112:0:3302:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00100000:1.0:1782224329.639117:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333034624:0@lo:9:umount.0 00000020:00080000:1.0:1782224329.661554:0:12860:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff96ea860dcd40) has no exports 00000020:00000080:1.0:1782224329.738500:0:12860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b16465c 00000020:00000080:1.0:1782224329.738517:0:12860:0:(genops.c:906:class_export_put()) final put ffff96eabd0ea000/lustre-QMT0000_UUID 00000020:01000000:1.0:1782224329.738593:0:12860:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1782224329.738797:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabd0ea000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1782224329.738950:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782224329.738961:0:12860:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1782224329.738966:0:12860:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff96eabf19cd40) has no exports 00000020:00000080:0.0:1782224329.739609:0:12860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b164655 00000020:00000080:0.0:1782224329.739617:0:12860:0:(genops.c:906:class_export_put()) final put ffff96eabf1a4800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1782224329.739742:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabf1a4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1782224329.739807:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782224329.739815:0:12860:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1782224329.739818:0:12860:0:(genops.c:906:class_export_put()) final put ffff96eabd104000/lustre-QMT0000_UUID 00000020:00000080:0.0:1782224329.739821:0:12860:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabd104000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1782224329.739828:0:12860:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:2.0:1782224330.434138:0:6608:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782224330.434150:0:6608:0:(genops.c:906:class_export_put()) final put ffff96e9854da000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1782224330.434237:0:6608:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 00000020:00000080:2.0:1782224330.434241:0:6608:0:(genops.c:906:class_export_put()) final put ffff96ea83555000/3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 00000020:00000080:1.0:1782224330.434380:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96e9854da000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1782224330.434435:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96e9854d8000 for lustre-OST0000 00000020:00000080:3.0:1782224330.434577:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96ea83555000/3d3afc9e-cffb-4c00-a81a-46cb6d7b2b39 for lustre-OST0000 00000020:00000080:3.0:1782224330.434921:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96ea83552800 for lustre-OST0000 00010000:00010000:2.0:1782224330.452216:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782224331.418908:0:5808:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fff0e469-4c8f-4b03-af7c-046a658bf816 00000001:00080000:3.0:1782224331.418927:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1782224331.418932:0:5808:0:(genops.c:906:class_export_put()) final put ffff96eaa7f72800/fff0e469-4c8f-4b03-af7c-046a658bf816 00000020:00000080:1.0:1782224331.420106:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96eaa7f72800/fff0e469-4c8f-4b03-af7c-046a658bf816 for lustre-MDT0000 00000020:00000080:1.0:1782224331.420183:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96eaa7f75000 for lustre-MDT0000 00000001:00100000:1.0:1782224331.421942:0:7486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782224331.421951:0:7486:0:(genops.c:906:class_export_put()) final put ffff96eabc602000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782224331.421978:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabc602000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1782224331.422045:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96eabc600000 for lustre-OST0001 00010000:00010000:2.0:1782224331.478129:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1782224331.796321:0:12860:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96eabc317d80 - data ffff96eab4fddd80/ffff96eac1d4f800 00000020:01000000:0.0:1782224331.796491:0:12860:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96ea85ce4d20 - data ffff96eab4f64510/ffff96eabf2b2400 00000001:00000004:0.0:1782224331.806452:0:12860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1782224331.991758:0:12860:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1782224331.991768:0:12860:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1782224331.991792:0:12860:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00100000:2.0:1782224331.991795:0:12860:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1782224331.992543:0:6701:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1782224331.992549:0:6701:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1782224331.992559:0:6701:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1782224331.997344:0:12860:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1782224331.997353:0:12860:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1782224331.997382:0:12860:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00100000:0.0:1782224331.997385:0:12860:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1782224331.998224:0:7851:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1782224331.998231:0:7851:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1782224331.998242:0:7851:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1782224332.108249:0:12860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b164624 00000020:00000080:0.0:1782224332.108262:0:12860:0:(genops.c:906:class_export_put()) final put ffff96ea9c4a3800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1782224332.108328:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96ea9c4a3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1782224332.109799:0:12860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b164639 00000020:00000080:0.0:1782224332.109811:0:12860:0:(genops.c:906:class_export_put()) final put ffff96eabd102800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1782224332.109833:0:12860:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1782224332.109839:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782224332.109847:0:12860:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1782224332.109852:0:12860:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff96ea860db380) has no exports 00000020:00000080:1.0:1782224332.109880:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabd102800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1782224332.110269:0:12860:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1782224332.110279:0:12860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b164877 00000020:00000080:0.0:1782224332.110284:0:12860:0:(genops.c:906:class_export_put()) final put ffff96eabc605800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1782224332.110301:0:12860:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1782224332.110306:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782224332.110313:0:12860:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1782224332.110316:0:12860:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff96ea83ef8000) has no exports 00000020:00000080:0.0:1782224332.110324:0:12860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b164870 00000020:00000080:1.0:1782224332.110326:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabc605800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1782224332.110329:0:12860:0:(genops.c:906:class_export_put()) final put ffff96eaa4803000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1782224332.110353:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96eaa4803000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1782224332.111920:0:12860:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1782224332.111928:0:12860:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1782224332.111934:0:12860:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1782224332.111940:0:12860:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00100000:0.0:1782224332.111943:0:12860:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782224332.111994:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782224332.112004:0:12860:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782224332.112012:0:12860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b164790 00000020:00000080:2.0:1782224332.112071:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96eaa4803800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1782224332.112082:0:36:0:(genops.c:906:class_export_put()) final put ffff96e9854df800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782224332.112086:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96e9854df800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1782224332.112099:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782224332.112142:0:12860:0:(genops.c:906:class_export_put()) final put ffff96e984e3e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1782224332.112154:0:12860:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1782224332.112171:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782224332.112176:0:12860:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1782224332.112180:0:12860:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff96ea833b99c0) has no exports 00000020:00000080:0.0:1782224332.112187:0:12860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b164789 00000020:00000080:0.0:1782224332.112192:0:12860:0:(genops.c:906:class_export_put()) final put ffff96ea9834d800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782224332.112208:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96e984e3e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1782224332.112217:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96ea9834d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1782224332.112565:0:12860:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1782224332.112569:0:12860:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1782224332.112571:0:12860:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1782224332.112575:0:12860:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00100000:0.0:1782224332.112577:0:12860:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1782224332.112686:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96ea9834f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1782224332.113145:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782224332.113154:0:12860:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782224332.113157:0:12860:0:(genops.c:906:class_export_put()) final put ffff96eaa7a45000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782224332.113160:0:12860:0:(genops.c:865:class_export_destroy()) destroying export ffff96eaa7a45000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1782224332.113165:0:12860:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782224332.113294:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782224332.113299:0:12860:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782224332.113302:0:12860:0:(genops.c:906:class_export_put()) final put ffff96ea86a20000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782224332.113305:0:12860:0:(genops.c:865:class_export_destroy()) destroying export ffff96ea86a20000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1782224332.113308:0:12860:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782224332.113406:0:12860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b164640 00000020:00000080:0.0:1782224332.113412:0:12860:0:(genops.c:906:class_export_put()) final put ffff96eabd105000/lustre-MDD0000_UUID 00000020:01000000:0.0:1782224332.113430:0:12860:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1782224332.113434:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782224332.113438:0:12860:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1782224332.113441:0:12860:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff96ea860d99c0) has no exports 00000020:00000080:0.0:1782224332.113461:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782224332.113464:0:12860:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1782224332.113468:0:12860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b164647 00000020:00000080:0.0:1782224332.113471:0:12860:0:(genops.c:906:class_export_put()) final put ffff96eabd101800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1782224332.113479:0:12860:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96ea982ae000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1782224332.113493:0:12860:0:(obd_mount.c:701:lustre_put_lsi()) put ffff96ea982ae000 3 00000020:01000004:0.0:1782224332.113497:0:12860:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96ea982ae000 from lustre-MDT0000 00000020:00000080:0.0:1782224332.113519:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782224332.113522:0:12860:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1782224332.113525:0:12860:0:(genops.c:906:class_export_put()) final put ffff96ea9c4a6000/lustre-MDT0000_UUID 00000020:00000080:0.0:1782224332.113527:0:12860:0:(genops.c:865:class_export_destroy()) destroying export ffff96ea9c4a6000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1782224332.113534:0:12860:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1782224332.113561:0:12860:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1782224332.113564:0:12860:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1782224332.113567:0:12860:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1782224332.113570:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782224332.113573:0:12860:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1782224332.113579:0:12860:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff96ea9c967800 b33607d9-62cb-4729-8187-59883763158a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782224332.113584:0:12860:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff96ea90cb4d40) has exports, disconnecting them 00000020:00080000:0.0:1782224332.113589:0:12860:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff96ea9c967800), last request at 1782224089 00000020:00000080:0.0:1782224332.113602:0:12860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b1645e5 00000020:00010000:0.0:1782224332.113606:0:12860:0:(genops.c:1942:obd_stale_export_put()) Put export ffff96ea9c967800: total 2 00000100:00080000:0.0:1782224332.113609:0:12860:0:(import.c:65:import_set_state_nolock()) ffff96ea9c964800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1782224332.113716:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabd105000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1782224332.113722:0:37:0:(genops.c:906:class_export_put()) final put ffff96ea86a22000/lustre-MDD0000_UUID 00000020:00000080:1.0:1782224332.113724:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96ea86a22000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1782224332.113728:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1782224332.113923:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabd101800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1782224332.114401:0:5773:0:(genops.c:1928:obd_stale_export_get()) Get export ffff96ea9c967800: total 0 00000020:00080000:0.0:1782224332.114402:0:12860:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96ea9c967800): rc 0 00000020:00080000:0.0:1782224332.114410:0:12860:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff96ea90cb4d40) has no exports 00010000:00010000:2.0:1782224332.114439:0:5773:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff96ea9c967800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1782224332.114475:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea99877400/0xcfd8b3ae4b1648f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfd8b3ae4b1648ee expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224332.114499:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabbbaa000/0xcfd8b3ae4b164b33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfd8b3ae4b164b2c expref: 8 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224332.114512:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b1648e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfd8b3ae4b1648e0 expref: 7 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224332.114537:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea99876800/0xcfd8b3ae4b164903 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfd8b3ae4b1648fc expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224332.114547:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea99877600/0xcfd8b3ae4b164b41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfd8b3ae4b164b3a expref: 5 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224332.114561:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabb611400/0xcfd8b3ae4b164911 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfd8b3ae4b16490a expref: 4 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224332.114573:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea80030a00/0xcfd8b3ae4b1646fd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfd8b3ae4b1646f6 expref: 3 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224332.114586:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabbb86400/0xcfd8b3ae4b16493b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcfd8b3ae4b164934 expref: 2 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224332.114596:0:5773:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff96ea9c967800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1782224332.114609:0:5773:0:(genops.c:906:class_export_put()) final put ffff96ea9c967800/b33607d9-62cb-4729-8187-59883763158a 00010000:00010000:2.0:1782224332.114638:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224332.114641:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224332.114643:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224332.114762:0:5781:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff96ea85de7400:5781] 2 exiting: rc = 0 00000020:00000080:0.0:1782224332.115010:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96ea9c967800/b33607d9-62cb-4729-8187-59883763158a for MGS 00000020:00000080:0.0:1782224332.115067:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96ea9c964800 for MGS 00000100:00100000:0.0:1782224332.116567:0:5779:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff96ea83303a00:5779] 0 exiting: rc = 1 00000100:00100000:3.0:1782224332.116784:0:5780:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff96ea85de7c00:5780] 1 exiting: rc = 0 00000100:00100000:2.0:1782224332.117132:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117140:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117146:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117151:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117159:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117165:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117171:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117179:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117187:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117194:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117217:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117239:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117249:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117257:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117270:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117278:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117285:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117293:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117441:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117450:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117457:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117464:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117471:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117477:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117483:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117489:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117496:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117502:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117507:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117513:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117519:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117524:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117530:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117537:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117542:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117547:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117552:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117558:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117563:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117568:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117573:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117578:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117584:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117591:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117596:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117608:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117613:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117619:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117636:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117643:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117648:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117654:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117660:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117666:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117672:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117677:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117683:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117688:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117694:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117700:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117706:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117712:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117718:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224332.117723:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1782224332.118302:0:12860:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1782224332.118306:0:12860:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1782224332.119484:0:12860:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96eabc3175a0 - data ffff96eac1e86e58/ffff96eac1d4d800 00000020:01000000:2.0:1782224332.119578:0:12860:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96ea874eede0 - data ffff96eab4f56798/ffff96ea90c57000 00000020:00000080:2.0:1782224332.120071:0:12860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b1645c9 00000020:00000080:2.0:1782224332.120080:0:12860:0:(genops.c:906:class_export_put()) final put ffff96eaadac0800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1782224332.120098:0:12860:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96ea982ae000 from MGS, refs=2 00000020:01000004:2.0:1782224332.120102:0:12860:0:(obd_mount.c:701:lustre_put_lsi()) put ffff96ea982ae000 2 00000020:01000004:2.0:1782224332.120105:0:12860:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96ea982ae000 from MGS 00000020:00000080:0.0:1782224332.120120:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96eaadac0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782224332.120144:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782224332.120152:0:12860:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1782224332.120155:0:12860:0:(genops.c:906:class_export_put()) final put ffff96eaadac0000/MGS 00000020:00000080:2.0:1782224332.120158:0:12860:0:(genops.c:865:class_export_destroy()) destroying export ffff96eaadac0000/MGS for MGS 00000020:01000000:2.0:1782224332.120164:0:12860:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1782224332.120220:0:12860:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1782224332.120352:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782224332.120358:0:12860:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782224332.120365:0:12860:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff96eabf38f000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782224332.120370:0:12860:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff96ea90cb0000) has exports, disconnecting them 00000020:00080000:2.0:1782224332.120375:0:12860:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff96eabf38f000), last request at 1782224091 00000020:00000080:2.0:1782224332.120379:0:12860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b164694 00000020:00080000:2.0:1782224332.120386:0:12860:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96eabf38f000): rc 0 00000020:00000080:2.0:1782224332.120392:0:12860:0:(genops.c:906:class_export_put()) final put ffff96eabf38f000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1782224332.120691:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabf38f000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1782224332.121094:0:12860:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1782224332.121099:0:12860:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782224332.121103:0:12860:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1782224332.121120:0:12860:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782224332.121215:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782224332.121221:0:12860:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1782224332.121332:0:12860:0:(obd_mount.c:701:lustre_put_lsi()) put ffff96ea982ae000 1 00000020:00000080:2.0:1782224332.121337:0:12860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b1645bb 00000020:00000080:2.0:1782224332.121342:0:12860:0:(genops.c:906:class_export_put()) final put ffff96eaadac6800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1782224332.121346:0:12860:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1782224332.121351:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782224332.121354:0:12860:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782224332.121357:0:12860:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff96ea860d8000) has no exports 00000020:00000080:0.0:1782224332.121522:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96eabf38a800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1782224332.121531:0:37:0:(genops.c:906:class_export_put()) final put ffff96eabd0eb000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1782224332.121533:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabd0eb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1782224332.121541:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1782224332.121595:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96eaadac6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1782224332.205748:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782224332.205766:0:12860:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1782224332.205772:0:12860:0:(genops.c:906:class_export_put()) final put ffff96ea982ad000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1782224332.205778:0:12860:0:(genops.c:865:class_export_destroy()) destroying export ffff96ea982ad000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1782224332.205790:0:12860:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1782224332.205932:0:12860:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff96ea982ad800 00000020:01000000:0.0:1782224332.205956:0:12860:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1782224332.205961:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782224332.205965:0:12860:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1782224332.205969:0:12860:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff96ea90cb19c0) has no exports 00000100:00100000:3.0:1782224332.207325:0:5786:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff96ea89bd8200:5786] 0 exiting: rc = 1 00000100:00100000:2.0:1782224332.207327:0:6605:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff96eac1d60a00:6605] 3 exiting: rc = 0 00000100:00100000:3.0:1782224332.207553:0:5788:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff96ea89bd9e00:5788] 2 exiting: rc = 0 00000100:00100000:0.0:1782224332.210213:0:5787:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff96ea89bd8800:5787] 1 exiting: rc = 0 00000100:00100000:0.0:1782224332.210343:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210356:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210365:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210376:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210385:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210395:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210406:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210416:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210438:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210447:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210457:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210465:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210474:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210482:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210489:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210498:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210506:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210515:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210523:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210533:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210540:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210548:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210555:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210575:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210581:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210592:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210603:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210612:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210618:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210626:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210633:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210638:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210644:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210649:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210655:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210673:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210680:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210685:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210691:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210697:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210702:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210707:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210713:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210719:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210725:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210730:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210735:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210740:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210745:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210750:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210755:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210761:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210766:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210771:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210850:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210855:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210861:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210866:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210879:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210884:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210889:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210894:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210899:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.210913:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.216187:0:11907:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff96eaaa1c6600:11907] 2 exiting: rc = 0 00000100:00100000:1.0:1782224332.216213:0:5790:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff96ea83e89200:5790] 1 exiting: rc = 0 00000100:00100000:0.0:1782224332.217173:0:5789:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff96ea83e88c00:5789] 0 exiting: rc = 1 00000100:00100000:0.0:1782224332.220122:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220133:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220141:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220150:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220156:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220162:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220169:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220175:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220181:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220188:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220194:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220201:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220207:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220212:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220217:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220222:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220228:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220232:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220237:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220243:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220249:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220254:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220259:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220263:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220269:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220274:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220280:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220298:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220303:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220309:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220316:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220321:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220326:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220331:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220336:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220341:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220345:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220350:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220354:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220359:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220364:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220369:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220373:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220379:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220384:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220390:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220394:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220399:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220405:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220413:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220491:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220501:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220508:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220514:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220521:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220527:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220533:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220538:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220544:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220550:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220556:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220561:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220574:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.220580:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.221415:0:5792:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff96ea9c979a00:5792] 1 exiting: rc = 0 00000100:00100000:1.0:1782224332.221551:0:5791:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff96ea9c979600:5791] 0 exiting: rc = 1 00000100:00100000:0.0:1782224332.221620:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221628:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221635:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221642:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221648:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221654:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221668:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221674:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221683:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221689:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221697:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221703:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221709:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221715:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221721:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221726:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221732:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221738:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221759:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221766:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221836:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221846:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221853:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221860:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221866:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221873:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221880:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221886:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221892:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221898:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221919:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221926:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221931:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221955:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221961:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221968:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221973:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221980:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221987:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221994:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.221999:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222005:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222166:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222176:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222182:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222187:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222193:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222199:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222205:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222210:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222215:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222222:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222229:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222235:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222253:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222261:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222267:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222274:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222279:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222286:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222293:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222300:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222307:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.222322:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.232821:0:5793:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff96ea9c979200:5793] 0 exiting: rc = 1 00000100:00100000:0.0:1782224332.233083:0:5794:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff96ea9c978600:5794] 1 exiting: rc = 0 00000100:00100000:1.0:1782224332.233294:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233302:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233308:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233314:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233320:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233326:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233332:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233338:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233344:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233349:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233355:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233360:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233366:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233371:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233376:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233381:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233386:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233392:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233398:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233402:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233407:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233412:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233417:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233423:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233428:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233433:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233438:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233443:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233448:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233453:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233458:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233463:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233468:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233473:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233492:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233497:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233502:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233508:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233515:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233521:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233528:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233533:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233539:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233545:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233551:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233556:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233562:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.233569:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.234718:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.234728:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.234736:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.234744:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.234753:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.234761:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.234769:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.234775:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.234781:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.234785:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.235169:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.235178:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.235183:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.235189:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.235195:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.235202:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.235897:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff96ea85cf9c00:5796] 1 exiting: rc = 0 00000100:00100000:0.0:1782224332.237115:0:5795:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff96ea85cf8400:5795] 0 exiting: rc = 1 00000100:00100000:1.0:1782224332.237527:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237534:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237539:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237545:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237551:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237572:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237577:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237582:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237587:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237592:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237597:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237602:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237607:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237612:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237618:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237622:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237627:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237632:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237638:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237643:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237647:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237652:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237657:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237662:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237667:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237672:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237678:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237682:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237687:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237693:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237698:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237703:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237708:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237714:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237719:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237725:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237730:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237736:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237741:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237746:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237759:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237765:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237771:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237776:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237781:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.237786:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.238150:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.238159:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.238163:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.238168:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.238173:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.238178:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.238183:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.238187:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.238192:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.238196:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.238200:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.238204:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.238209:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.238213:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.238217:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.238221:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.238496:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.238505:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.239887:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff96ea85cf9000:5797] 0 exiting: rc = 1 00000100:00100000:0.0:1782224332.241170:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff96ea85cf9600:5798] 1 exiting: rc = 0 00000100:00100000:1.0:1782224332.241338:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241347:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241353:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241359:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241364:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241368:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241374:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241379:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241384:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241389:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241395:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241413:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241418:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241423:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241429:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241434:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241438:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241443:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241448:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241453:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241458:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241464:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241469:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241474:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241479:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241484:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241490:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241495:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241500:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241505:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241510:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241516:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241520:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241525:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241530:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241535:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241540:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241544:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241549:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241555:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241561:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241566:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241571:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241577:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241582:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241587:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241600:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241605:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241610:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241615:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241619:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241624:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241629:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241634:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241638:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241643:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241648:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241652:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241657:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241662:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241666:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241671:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241675:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.241681:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224332.242169:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff96ea9c99ac00:5799] 0 exiting: rc = 1 00000100:00100000:0.0:1782224332.242340:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff96ea85cf8c00:5800] 1 exiting: rc = 0 00000100:00100000:0.0:1782224332.242515:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff96ea85cf9200:5801] 2 exiting: rc = 0 00000100:00100000:1.0:1782224332.243000:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243010:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243031:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243038:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243044:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243050:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243057:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243063:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243070:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243077:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243083:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243089:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243095:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243100:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243117:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243125:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243131:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243149:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243157:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243179:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243188:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243197:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243205:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243213:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243221:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243575:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243583:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243589:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243597:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243603:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243611:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243616:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243622:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243629:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243636:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243643:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243648:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243654:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243660:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243668:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243674:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243680:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243685:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243715:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243724:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243733:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243745:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243752:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243758:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243764:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243771:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.243777:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.244148:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.244159:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.244167:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.244177:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.244187:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.244198:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.244210:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.244216:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.244221:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.244345:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.244352:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782224332.244357:0:12860:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1782224332.254339:0:12860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782224332.254353:0:12860:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1782224332.254359:0:12860:0:(genops.c:906:class_export_put()) final put ffff96ea86a27800/MDS_uuid 00000020:00000080:0.0:1782224332.254364:0:12860:0:(genops.c:865:class_export_destroy()) destroying export ffff96ea86a27800/MDS_uuid for MDS 00000020:01000000:0.0:1782224332.254372:0:12860:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1782224332.254518:0:12860:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1782224332.504811:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224333.528247:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224333.912454:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1868797333035392:0@lo:400:kworker.0 00000400:00000100:2.0:1782224333.912508:0:3306:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868797333035392 offset 0 length 224: 4 00000100:00100000:2.0:1782224333.912554:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782224333.912559:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797333035264:0@lo:400:kworker.0 00000400:00000100:2.0:1782224333.912574:0:3306:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868797333035264 offset 0 length 224: 4 00000100:00100000:2.0:1782224333.912595:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1868797333035520:0@lo:400:kworker.0 00000400:00000100:2.0:1782224333.912617:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868797333035520 offset 0 length 224: 4 00010000:00010000:0.0:1782224334.548334:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782224335.370502:0:13014:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1782224335.384839:0:13014:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1782224335.384886:0:13014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675000/0xcfd8b3ae4b1648fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164903 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224335.384900:0:13014:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675000/0xcfd8b3ae4b1648fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164903 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224335.384907:0:13014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675000/0xcfd8b3ae4b1648fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b164903 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224335.384915:0:13014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff96ea90675000/0xcfd8b3ae4b1648fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b164903 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224335.384956:0:13014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782224335.384963:0:13014:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1782224335.384990:0:13014:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782224335.385001:0:13014:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff96ea83278000 x1868797333035392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224349 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224335.385038:0:13014:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1782224335.385071:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1868797333035392:0@lo:400:kworker.0 00000100:00080000:2.0:1782224335.385111:0:13014:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1782224335.385135:0:13014:0:(import.c:65:import_set_state_nolock()) ffff96e985539800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1782224335.385208:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224335.385215:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea90675000/0xcfd8b3ae4b1648fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b164903 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224335.385223:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675000 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:0.0:1782224335.385227:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea90675000/0xcfd8b3ae4b1648fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b164903 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224335.385236:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea90675000/0xcfd8b3ae4b1648fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfd8b3ae4b164903 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782224335.385243:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea90675000/0xcfd8b3ae4b1648fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfd8b3ae4b164903 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782224335.385249:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782224335.385252:0:5773:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782224335.385255:0:5773:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782224335.385281:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96ea90675000/0xcfd8b3ae4b1648fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfd8b3ae4b164903 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224335.385305:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782224335.385332:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea90675000/0xcfd8b3ae4b1648fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfd8b3ae4b164903 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224335.385340:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea90675000/0xcfd8b3ae4b1648fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcfd8b3ae4b164903 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224335.385353:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224335.385355:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224335.385357:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224335.385366:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782224335.385380:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797333035776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782224335.385451:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224335.385506:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333035776 00000100:00100000:0.0:1782224335.385513:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333035776 00000100:00100000:0.0:1782224335.385547:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782224335.385554:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3303:x1868797333035776:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1782224335.385560:0:5772:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782224335 with bad export cookie 14976918121986016741 00000100:00100000:1.0:1782224335.386795:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1868797333035648:0@lo:39:umount.0 00000400:00000100:1.0:1782224335.386844:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868797333035648 offset 0 length 224: 4 00000100:00100000:0.0:1782224335.406085:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3303:x1868797333035776:12345-0@lo:103:ldlm_bl.0 Request processed in 20513us (20617us total) trans 0 rc -107/-107 00000100:00100000:0.0:1782224335.406100:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1782224335.406122:0:3303:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.107@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1782224335.406128:0:3303:0:(import.c:65:import_set_state_nolock()) ffff96ea83e01800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1782224335.406132:0:3303:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.107@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1782224335.414111:0:3303:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.107@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1782224335.414134:0:3303:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1782224335.414143:0:3303:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff96ea8327bb80 x1868797333035264/t0(0) o400->MGC192.168.202.107@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1782224349 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224335.414181:0:3303:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff96eaa7a08000 x1868797333035776/t0(0) o103->MGC192.168.202.107@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782224351 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1782224335.414192:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1782224335.414195:0:3303:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1782224335.414196:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1782224335.414200:0:3303:0:(import.c:65:import_set_state_nolock()) ffff96ea83e01800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782224335.414205:0:3303:0:(import.c:512:import_select_connection()) MGC192.168.202.107@tcp: connect to NID 0@lo last attempt 170 00000100:00080000:2.0:1782224335.414213:0:3303:0:(import.c:626:import_select_connection()) MGC192.168.202.107@tcp: import ffff96ea83e01800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:2.0:1782224335.414244:0:3303:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96ea83279500 x1868797333035904/t0(0) o250->MGC192.168.202.107@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782224335.414314:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b33607d9-62cb-4729-8187-59883763158a:3302:1868797333035904:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1782224335.414368:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868797333035904 offset 0 length 520: 4 00000100:00100000:0.0:1782224335.414513:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b33607d9-62cb-4729-8187-59883763158a:3306:1868797333035264:0@lo:400:kworker.0 00000100:00100000:2.0:1782224335.414572:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b33607d9-62cb-4729-8187-59883763158a:3303:1868797333035776:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782224335.572547:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224336.596360:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224337.620929:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224338.644284:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782224339.031251:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) b33607d9-62cb-4729-8187-59883763158a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782224339.031262:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) b33607d9-62cb-4729-8187-59883763158a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782224339.031400:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782224339.031434:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333036032:0@lo:400:kworker.0 00000400:00000100:0.0:1782224339.031490:0:3306:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868797333036032 offset 0 length 224: 4 00010000:00010000:0.0:1782224339.670195:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224340.692906:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782224341.076564:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) b33607d9-62cb-4729-8187-59883763158a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782224341.076575:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) b33607d9-62cb-4729-8187-59883763158a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782224341.076759:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333036160:0@lo:400:kworker.0 00000400:00000100:2.0:1782224341.076826:0:3306:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868797333036160 offset 0 length 224: 4 00010000:00010000:0.0:1782224341.716762:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224342.742471:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224343.764421:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224344.789804:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224345.686368:0:3302:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782224335/real 1782224335] req@ffff96ea83279500 x1868797333035904/t0(0) o250->MGC192.168.202.107@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782224345 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224345.686400:0:3302:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96ea83279500 x1868797333035904/t0(0) o250->MGC192.168.202.107@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782224345 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224345.686412:0:3302:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782224335/real 1782224335] req@ffff96ea83278000 x1868797333035648/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782224345 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224345.686432:0:3302:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96ea83278000 x1868797333035648/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782224345 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782224345.686451:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96ea83e01800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782224345.686485:0:3302:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1782224345.686490:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b33607d9-62cb-4729-8187-59883763158a:3302:1868797333035904:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1782224345.686497:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96e985539800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1782224345.686515:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1868797333035648:0@lo:39:umount.0 00000100:00080000:0.0:1782224345.686630:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) b33607d9-62cb-4729-8187-59883763158a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782224345.686636:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1782224345.686639:0:37:0:(import.c:65:import_set_state_nolock()) ffff96ea83e01800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782224345.686644:0:37:0:(import.c:512:import_select_connection()) MGC192.168.202.107@tcp: connect to NID 0@lo last attempt 416 00000100:00080000:0.0:1782224345.686661:0:37:0:(import.c:591:import_select_connection()) MGC192.168.202.107@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782224345.686668:0:37:0:(import.c:626:import_select_connection()) MGC192.168.202.107@tcp: import ffff96ea83e01800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:0.0:1782224345.686698:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96eaa7a0b800 x1868797333036288/t0(0) o250->MGC192.168.202.107@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782224345.691881:0:13014:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782224345.691890:0:13014:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1782224345.691897:0:13014:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1782224345.698289:0:13014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90674c00/0xcfd8b3ae4b16490a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164911 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224345.698310:0:13014:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90674c00/0xcfd8b3ae4b16490a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164911 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224345.698318:0:13014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90674c00/0xcfd8b3ae4b16490a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b164911 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224345.698325:0:13014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff96ea90674c00/0xcfd8b3ae4b16490a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b164911 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224345.698363:0:13014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782224345.698371:0:13014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675200/0xcfd8b3ae4b164b3a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164b41 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224345.698378:0:13014:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675200/0xcfd8b3ae4b164b3a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164b41 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224345.698385:0:13014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675200/0xcfd8b3ae4b164b3a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b164b41 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224345.698409:0:13014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff96ea90675200/0xcfd8b3ae4b164b3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b164b41 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224345.698435:0:13014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1782224345.698441:0:13014:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1782224345.698469:0:13014:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1782224345.698473:0:13014:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1782224345.698477:0:13014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782224345.698483:0:13014:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782224345.698487:0:13014:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff96ea83ecb380) has no exports 00000020:00080000:2.0:1782224345.698511:0:13014:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff96ea83ecb380) has no exports 00010000:00010000:1.0:1782224345.700256:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782224345.700269:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea90674c00/0xcfd8b3ae4b16490a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b164911 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224345.700280:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674c00 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:1.0:1782224345.700284:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea90674c00/0xcfd8b3ae4b16490a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b164911 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224345.700294:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea90674c00/0xcfd8b3ae4b16490a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfd8b3ae4b164911 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224345.700302:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea90674c00/0xcfd8b3ae4b16490a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfd8b3ae4b164911 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224345.700323:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782224345.700326:0:5774:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1782224345.700330:0:5774:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1782224345.700346:0:5774:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96ea83e01800 00010000:00010000:1.0:1782224345.700350:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea90674c00/0xcfd8b3ae4b16490a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfd8b3ae4b164911 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224345.700358:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea90674c00/0xcfd8b3ae4b16490a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfd8b3ae4b164911 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224345.700375:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224345.700379:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea90675200/0xcfd8b3ae4b164b3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b164b41 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224345.700384:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675200 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:1.0:1782224345.700387:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea90675200/0xcfd8b3ae4b164b3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b164b41 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224345.700394:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea90675200/0xcfd8b3ae4b164b3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfd8b3ae4b164b41 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224345.700400:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea90675200/0xcfd8b3ae4b164b3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfd8b3ae4b164b41 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224345.700405:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1782224345.700407:0:5774:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1782224345.700409:0:5774:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1782224345.700413:0:5774:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96ea83e01800 00010000:00010000:1.0:1782224345.700416:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea90675200/0xcfd8b3ae4b164b3a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfd8b3ae4b164b41 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224345.700429:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea90675200/0xcfd8b3ae4b164b3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfd8b3ae4b164b41 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224345.700440:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224345.700442:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224345.700443:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224345.700471:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1782224345.705670:0:13014:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96ea85116d20 - data ffff96eac1eb3af8/ffff96e984dad400 00000020:01000000:2.0:1782224345.705785:0:13014:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96eaadadcb40 - data ffff96eaa45ff948/ffff96eaa7a31400 00000100:00100000:2.0:1782224345.710191:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b33607d9-62cb-4729-8187-59883763158a:3302:1868797333036288:0@lo:250:kworker.0 00000400:00000100:2.0:1782224345.710271:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868797333036288 offset 0 length 520: 4 00000100:00100000:1.0:1782224345.710570:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1868797333036416:0@lo:400:kworker.0 00000400:00000100:1.0:1782224345.710607:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868797333036416 offset 0 length 224: 4 00100000:10000000:3.0:1782224345.731442:0:13014:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1782224345.788222:0:13014:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b164719 00000020:00000080:2.0:1782224345.788232:0:13014:0:(genops.c:906:class_export_put()) final put ffff96e984e7c000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1782224345.788251:0:13014:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96ea8341a800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1782224345.788254:0:13014:0:(obd_mount.c:701:lustre_put_lsi()) put ffff96ea8341a800 2 00000020:01000004:2.0:1782224345.788257:0:13014:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96ea8341a800 from lustre-OST0000 00000020:00000080:2.0:1782224345.788279:0:13014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782224345.788289:0:13014:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1782224345.788292:0:13014:0:(genops.c:906:class_export_put()) final put ffff96e984e7f800/lustre-OST0000_UUID 00000020:00000080:2.0:1782224345.788294:0:13014:0:(genops.c:865:class_export_destroy()) destroying export ffff96e984e7f800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1782224345.788300:0:13014:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1782224345.788341:0:13014:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1782224345.788346:0:13014:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1782224345.788349:0:13014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782224345.788364:0:13014:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782224345.788371:0:13014:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff96e98553d000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782224345.788377:0:13014:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff96ea90cb3380) has exports, disconnecting them 00000020:00080000:2.0:1782224345.788382:0:13014:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff96e98553d000), last request at 1782224109 00000020:00000080:2.0:1782224345.788387:0:13014:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b164743 00000020:00080000:2.0:1782224345.788396:0:13014:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96e98553d000): rc 0 00000020:00000080:2.0:1782224345.788399:0:13014:0:(genops.c:906:class_export_put()) final put ffff96e98553d000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1782224345.788825:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96e984e7c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1782224345.788838:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96e98553d000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1782224345.791196:0:13014:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1782224345.791204:0:13014:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782224345.791209:0:13014:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1782224345.791217:0:13014:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1782224345.791380:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96e985539800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1782224345.791723:0:13014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782224345.791732:0:13014:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1782224345.791737:0:13014:0:(genops.c:906:class_export_put()) final put ffff96e98553b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1782224345.791741:0:13014:0:(genops.c:865:class_export_destroy()) destroying export ffff96e98553b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1782224345.791752:0:13014:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1782224345.791822:0:13014:0:(obd_mount.c:701:lustre_put_lsi()) put ffff96ea8341a800 1 00000020:00000080:0.0:1782224345.791828:0:13014:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b1646d3 00000020:00000080:0.0:1782224345.791835:0:13014:0:(genops.c:906:class_export_put()) final put ffff96ea8341f000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1782224345.791851:0:13014:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1782224345.791856:0:13014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782224345.791860:0:13014:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00000080:1.0:1782224345.791884:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96ea8341f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:0.0:1782224345.792010:0:13014:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff96ea83ec99c0) has no exports 00000020:00000080:1.0:1782224345.833794:0:13014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782224345.833810:0:13014:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1782224345.833815:0:13014:0:(genops.c:906:class_export_put()) final put ffff96ea8341d800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1782224345.833820:0:13014:0:(genops.c:865:class_export_destroy()) destroying export ffff96ea8341d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1782224345.833831:0:13014:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1782224345.833972:0:13014:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff96ea8341f800 00000020:02000400:1.0:1782224345.834061:0:13014:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1782224345.998051:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224347.029622:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224348.054223:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224349.080225:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782224349.084396:0:13168:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1782224349.098198:0:13168:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1782224349.098277:0:13168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb86c00/0xcfd8b3ae4b1648e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1648e7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224349.098292:0:13168:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb86c00/0xcfd8b3ae4b1648e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b1648e7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224349.098299:0:13168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb86c00/0xcfd8b3ae4b1648e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b1648e7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224349.098306:0:13168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff96eabbb86c00/0xcfd8b3ae4b1648e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b1648e7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224349.098328:0:13168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782224349.098335:0:13168:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1782224349.098356:0:13168:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782224349.098368:0:13168:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff96ea8327a680 x1868797333035520/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224349 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224349.098385:0:13168:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff96eabf797100 x1868797333036032/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224355 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224349.098398:0:13168:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff96eaa7a09500 x1868797333036160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224357 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224349.098427:0:13168:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff96eaa7a0b480 x1868797333036416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224361 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224349.098434:0:13168:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1782224349.098474:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333036160:0@lo:400:kworker.0 00000100:00100000:2.0:1782224349.098487:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333036032:0@lo:400:kworker.0 00000100:00080000:2.0:1782224349.098640:0:13168:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1782224349.098665:0:13168:0:(import.c:65:import_set_state_nolock()) ffff96eabfc75000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1782224349.098696:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1868797333036544:0@lo:39:umount.0 00000400:00000100:2.0:1782224349.098823:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868797333036544 offset 0 length 224: 4 00010000:00010000:0.0:1782224349.098947:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224349.098965:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabbb86c00/0xcfd8b3ae4b1648e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b1648e7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224349.098973:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86c00 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:0.0:1782224349.098978:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabbb86c00/0xcfd8b3ae4b1648e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b1648e7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224349.099074:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabbb86c00/0xcfd8b3ae4b1648e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfd8b3ae4b1648e7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782224349.099084:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabbb86c00/0xcfd8b3ae4b1648e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfd8b3ae4b1648e7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782224349.099090:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782224349.099093:0:5774:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782224349.099095:0:5774:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782224349.099115:0:5774:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96ea83e01800 00010000:00010000:0.0:1782224349.099120:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabbb86c00/0xcfd8b3ae4b1648e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfd8b3ae4b1648e7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224349.099127:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabbb86c00/0xcfd8b3ae4b1648e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfd8b3ae4b1648e7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224349.099150:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224349.099152:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224349.099153:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224349.102140:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1868797333036416:0@lo:400:kworker.0 00000100:00100000:2.0:1782224349.102157:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1868797333035520:0@lo:400:kworker.0 00010000:00010000:1.0:1782224350.100274:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782224350.808917:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) b33607d9-62cb-4729-8187-59883763158a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782224350.808929:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) b33607d9-62cb-4729-8187-59883763158a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1782224351.124897:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224352.149636:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224353.177180:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224354.200932:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224355.220650:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782224355.924324:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) b33607d9-62cb-4729-8187-59883763158a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782224355.924335:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) b33607d9-62cb-4729-8187-59883763158a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1782224356.244288:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224357.269220:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224358.292375:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224359.316257:0:3302:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782224349/real 1782224349] req@ffff96ea83278000 x1868797333036544/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782224359 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224359.316304:0:3302:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96ea83278000 x1868797333036544/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782224359 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782224359.316329:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96eabfc75000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1782224359.316349:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1868797333036544:0@lo:39:umount.0 00000100:00080000:2.0:1782224359.317306:0:13168:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782224359.317315:0:13168:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1782224359.317323:0:13168:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1782224359.318267:0:13168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb611200/0xcfd8b3ae4b1648ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1648f5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224359.318285:0:13168:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb611200/0xcfd8b3ae4b1648ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b1648f5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224359.318305:0:13168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabb611200/0xcfd8b3ae4b1648ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b1648f5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224359.318312:0:13168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff96eabb611200/0xcfd8b3ae4b1648ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b1648f5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224359.318338:0:13168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782224359.318345:0:13168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164b2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b164b33 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224359.318352:0:13168:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164b2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b164b33 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224359.318359:0:13168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164b2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b164b33 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224359.318365:0:13168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164b2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcfd8b3ae4b164b33 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224359.318382:0:13168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1782224359.318387:0:13168:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1782224359.318411:0:13168:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1782224359.318416:0:13168:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1782224359.318421:0:13168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782224359.318426:0:13168:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:3.0:1782224359.318433:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:2.0:1782224359.318433:0:13168:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff96ea833bb380) has no exports 00010000:00010000:3.0:1782224359.318461:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabb611200/0xcfd8b3ae4b1648ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b1648f5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782224359.318461:0:13168:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff96ea833bb380) has no exports 00010000:00010000:3.0:1782224359.318479:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabb611200 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:3.0:1782224359.318484:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabb611200/0xcfd8b3ae4b1648ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b1648f5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224359.318497:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabb611200/0xcfd8b3ae4b1648ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfd8b3ae4b1648f5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782224359.318505:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabb611200/0xcfd8b3ae4b1648ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfd8b3ae4b1648f5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224359.318511:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782224359.318515:0:5774:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1782224359.318518:0:5774:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1782224359.318541:0:5774:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96ea83e01800 00010000:00010000:3.0:1782224359.318546:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabb611200/0xcfd8b3ae4b1648ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfd8b3ae4b1648f5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224359.318552:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabb611200/0xcfd8b3ae4b1648ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfd8b3ae4b1648f5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224359.318571:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782224359.318575:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164b2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b164b33 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224359.318602:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675e00 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:3.0:1782224359.318605:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164b2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcfd8b3ae4b164b33 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224359.318613:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164b2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfd8b3ae4b164b33 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782224359.318619:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164b2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfd8b3ae4b164b33 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224359.318625:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1782224359.318628:0:5774:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1782224359.318630:0:5774:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1782224359.318638:0:5774:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96ea83e01800 00010000:00010000:3.0:1782224359.318641:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164b2c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfd8b3ae4b164b33 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224359.318648:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b164b2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfd8b3ae4b164b33 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224359.318669:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224359.318672:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224359.318674:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224359.318890:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1782224359.320077:0:13168:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96ea85116000 - data ffff96eac1eb36c0/ffff96eabf72a000 00000020:01000000:2.0:1782224359.320171:0:13168:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96eaa7c49a80 - data ffff96eac1e0d0d8/ffff96eabf717800 00010000:00010000:3.0:1782224359.324834:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1782224359.331979:0:13168:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1782224359.453005:0:13168:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b1647e4 00000020:00000080:1.0:1782224359.453046:0:13168:0:(genops.c:906:class_export_put()) final put ffff96eabf83c000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1782224359.453061:0:13168:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96eabfbe5800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1782224359.453065:0:13168:0:(obd_mount.c:701:lustre_put_lsi()) put ffff96eabfbe5800 2 00000020:01000004:1.0:1782224359.453068:0:13168:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96eabfbe5800 from lustre-OST0001 00000020:00000080:1.0:1782224359.453092:0:13168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782224359.453102:0:13168:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1782224359.453105:0:13168:0:(genops.c:906:class_export_put()) final put ffff96eabf83f800/lustre-OST0001_UUID 00000020:00000080:1.0:1782224359.453108:0:13168:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabf83f800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1782224359.453125:0:13168:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1782224359.453235:0:13168:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import b33607d9-62cb-4729-8187-59883763158a->MGS 00010000:00010000:1.0:1782224359.453253:0:13168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabb710400/0xcfd8b3ae4b1646f6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfd8b3ae4b1646fd expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224359.453267:0:13168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabb710400/0xcfd8b3ae4b1646f6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfd8b3ae4b1646fd expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224359.453274:0:13168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1782224359.453276:0:13168:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1782224359.453279:0:13168:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1782224359.453293:0:13168:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96ea83e01800 00010000:00010000:1.0:1782224359.453297:0:13168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabb710400/0xcfd8b3ae4b1646f6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfd8b3ae4b1646fd expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224359.453312:0:13168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabb611800/0xcfd8b3ae4b164934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcfd8b3ae4b16493b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224359.453319:0:13168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabb611800/0xcfd8b3ae4b164934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcfd8b3ae4b16493b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224359.453337:0:13168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782224359.453340:0:13168:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1782224359.453341:0:13168:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1782224359.453357:0:13168:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96ea83e01800 00010000:00010000:1.0:1782224359.453360:0:13168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabb611800/0xcfd8b3ae4b164934 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcfd8b3ae4b16493b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782224359.453388:0:13168:0:(import.c:65:import_set_state_nolock()) ffff96ea83e01800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1782224359.453392:0:13168:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1782224359.453394:0:13168:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1782224359.453396:0:13168:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1782224359.453399:0:13168:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1782224359.453412:0:13168:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff96eaa7a0b800 x1868797333036288/t0(0) o250->MGC192.168.202.107@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1782224360 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1782224359.453751:0:13168:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1782224359.453755:0:13168:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000020:00000080:0.0:1782224359.453810:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabf83c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1782224359.454477:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b33607d9-62cb-4729-8187-59883763158a:3302:1868797333036288:0@lo:250:kworker.0 10000000:01000000:1.0:1782224359.454553:0:13168:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1782224359.454561:0:13168:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b1645d7 00000020:00000080:1.0:1782224359.454568:0:13168:0:(genops.c:906:class_export_put()) final put ffff96ea86a24800/b33607d9-62cb-4729-8187-59883763158a 00000020:01000000:1.0:1782224359.454584:0:13168:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.202.107@tcp (flags='') 00000020:00000080:1.0:1782224359.454591:0:13168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782224359.454597:0:13168:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.107@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1782224359.454602:0:13168:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff96ea833bcd40) has no exports 00000020:00000080:0.0:1782224359.454659:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96ea86a24800/b33607d9-62cb-4729-8187-59883763158a for MGC192.168.202.107@tcp 10000000:01000000:3.0:1782224359.454762:0:5783:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1782224359.454847:0:13168:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.107@tcp: client import never connected 00000100:00080000:1.0:1782224359.454859:0:13168:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1782224359.454861:0:13168:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1782224359.454863:0:13168:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1782224359.454865:0:13168:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1782224359.454940:0:13168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782224359.454946:0:13168:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.107@tcp (uuid b33607d9-62cb-4729-8187-59883763158a) 00000020:01000000:1.0:1782224359.454952:0:13168:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1782224359.454964:0:13168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782224359.454968:0:13168:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1782224359.454972:0:13168:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff96eabfc72000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782224359.454977:0:13168:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff96ea83eccd40) has exports, disconnecting them 00000020:00080000:1.0:1782224359.454982:0:13168:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff96eabfc72000), last request at 1782224130 00000020:00000080:1.0:1782224359.454987:0:13168:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b16480e 00000020:00080000:1.0:1782224359.454999:0:13168:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96eabfc72000): rc 0 00000020:00000080:1.0:1782224359.455002:0:13168:0:(genops.c:906:class_export_put()) final put ffff96eabfc72000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1782224359.455191:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96ea83e01800 for MGC192.168.202.107@tcp 00000020:00000080:0.0:1782224359.455199:0:8:0:(genops.c:906:class_export_put()) final put ffff96ea83e03800/b33607d9-62cb-4729-8187-59883763158a 00000020:00000080:0.0:1782224359.455202:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96ea83e03800/b33607d9-62cb-4729-8187-59883763158a for MGC192.168.202.107@tcp 00000020:01000000:0.0:1782224359.455206:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.107@tcp (b33607d9-62cb-4729-8187-59883763158a) 00000020:00000080:0.0:1782224359.455802:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabfc72000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1782224359.463038:0:13168:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1782224359.463050:0:13168:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782224359.463055:0:13168:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1782224359.463063:0:13168:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1782224359.463153:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1782224359.464237:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96eabfc75000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1782224359.464260:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1782224359.465212:0:5769:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff96ea89bd8400:5769] 1 exiting: rc = 0 00000100:00100000:3.0:1782224359.465409:0:5768:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff96ea89bd9800:5768] 0 exiting: rc = 1 00000100:00100000:0.0:1782224359.465557:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224359.465834:0:5772:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff96ea89bd9200:5772] 2 exiting: rc = 0 00000100:00100000:3.0:1782224359.465946:0:5770:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff96ea85d27c00:5770] 0 exiting: rc = 1 00000100:00100000:3.0:1782224359.466045:0:8291:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff96e984d4e400:8291] 3 exiting: rc = 0 00000100:00100000:0.0:1782224359.471588:0:5771:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff96ea89bd8c00:5771] 1 exiting: rc = 0 00000100:00100000:3.0:1782224359.471758:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471767:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471773:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471780:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471787:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471794:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471800:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471807:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471813:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471821:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471827:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471834:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471840:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471847:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471863:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471870:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471876:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471882:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471888:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471893:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471899:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471904:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471910:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471915:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471919:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471924:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471929:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471934:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471938:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471943:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471948:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471966:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471971:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471976:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471982:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471987:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471992:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.471999:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472004:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472009:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472040:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472047:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472052:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472057:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472062:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472067:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472072:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472077:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472082:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472087:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472093:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472098:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472103:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472108:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472112:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472117:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472122:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472127:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472131:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472137:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472142:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472147:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472151:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.472157:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1782224359.476412:0:13168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782224359.476427:0:13168:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1782224359.476449:0:13168:0:(genops.c:906:class_export_put()) final put ffff96eaa7a47800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1782224359.476454:0:13168:0:(genops.c:865:class_export_destroy()) destroying export ffff96eaa7a47800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1782224359.476461:0:13168:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1782224359.476557:0:13168:0:(obd_mount.c:701:lustre_put_lsi()) put ffff96eabfbe5800 1 00000020:00000080:3.0:1782224359.476565:0:13168:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcfd8b3ae4b1647b3 00000020:00000080:3.0:1782224359.476571:0:13168:0:(genops.c:906:class_export_put()) final put ffff96eaa7a40000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1782224359.476599:0:13168:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1782224359.476605:0:13168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782224359.476610:0:13168:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782224359.476614:0:13168:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff96ea833b8000) has no exports 00000020:00000080:0.0:1782224359.476723:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96eaa7a40000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1782224359.505978:0:13168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782224359.505995:0:13168:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1782224359.506002:0:13168:0:(genops.c:906:class_export_put()) final put ffff96eabfbe0800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1782224359.506006:0:13168:0:(genops.c:865:class_export_destroy()) destroying export ffff96eabfbe0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1782224359.506040:0:13168:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1782224359.506254:0:13168:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff96eabfbe4800 00000020:01000000:3.0:1782224359.506280:0:13168:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1782224359.506284:0:13168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782224359.506287:0:13168:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782224359.506292:0:13168:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff96ea83ec8000) has no exports 00000020:00000080:3.0:1782224359.506316:0:13168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782224359.506320:0:13168:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1782224359.506323:0:13168:0:(genops.c:906:class_export_put()) final put ffff96ea8341c800/OSS_uuid 00000020:00000080:3.0:1782224359.506325:0:13168:0:(genops.c:865:class_export_destroy()) destroying export ffff96ea8341c800/OSS_uuid for OSS 00000020:01000000:3.0:1782224359.506331:0:13168:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1782224359.510338:0:6585:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff96eabf88f000:6585] 2 exiting: rc = 0 00000100:00080000:0.0:1782224359.510835:0:5782:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1782224359.514242:0:6582:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff96eaa7d7fc00:6582] 0 exiting: rc = 1 00000100:00100000:2.0:1782224359.514452:0:6715:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff96ea8685cc00:6715] 3 exiting: rc = 0 00000100:00100000:2.0:1782224359.514525:0:6584:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff96eabf88e600:6584] 1 exiting: rc = 0 00000100:00100000:3.0:1782224359.514585:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514593:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514607:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514612:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514616:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514627:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514633:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514644:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514665:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514670:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514675:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514681:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514687:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514694:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514700:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514707:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514712:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514717:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514721:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514726:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514731:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514734:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514738:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514742:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514745:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514749:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514753:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514756:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514760:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514763:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514766:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514769:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514772:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514776:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514779:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514785:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514791:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514795:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514801:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514804:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514807:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514810:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514813:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514823:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514835:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514839:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514843:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514846:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514861:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514867:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514873:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514878:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514888:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514895:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514900:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514905:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514910:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514916:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514921:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514927:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.514932:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.516126:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.516140:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.516146:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224359.521527:0:6587:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff96eabf88e000:6587] 1 exiting: rc = 0 00000100:00100000:0.0:1782224359.521527:0:6586:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff96eaa7d7fa00:6586] 0 exiting: rc = 1 00000100:00100000:3.0:1782224359.521687:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521698:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521704:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521710:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521714:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521719:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521724:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521730:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521735:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521740:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521745:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521750:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521756:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521761:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521781:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521786:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521791:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521797:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521803:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521808:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521813:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521818:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521823:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521829:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521835:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521840:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521846:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521865:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521872:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521878:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521883:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521889:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521894:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521900:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521906:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521911:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521916:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521921:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521926:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.521932:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522005:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522031:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522038:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522043:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522049:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522054:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522059:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522065:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522070:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522082:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522088:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522093:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522098:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522102:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522107:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522113:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522118:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522123:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522128:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522133:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522138:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522143:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522148:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.522162:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224359.523671:0:6588:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff96ea880caa00:6588] 0 exiting: rc = 1 00000100:00100000:0.0:1782224359.523836:0:6589:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff96ea91c52400:6589] 1 exiting: rc = 0 00000100:00100000:0.0:1782224359.524246:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff96ea88631200:6590] 2 exiting: rc = 0 00000100:00100000:2.0:1782224359.524404:0:11906:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff96e984c83200:11906] 3 exiting: rc = 0 00000100:00100000:3.0:1782224359.524557:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524566:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524572:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524584:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524589:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524595:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524610:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524616:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524622:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524629:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524720:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524726:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524733:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524739:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524745:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524752:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524758:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524764:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524770:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524776:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524794:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524799:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524805:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524811:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524817:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524822:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524828:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524848:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524868:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524875:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524882:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524887:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524892:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524897:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524903:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524908:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524914:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524918:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524924:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524930:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524935:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524941:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524947:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524954:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524960:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524966:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524971:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524976:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524981:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524989:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.524995:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.525187:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.525195:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.525200:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.525205:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.525217:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.525222:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.525227:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.525233:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.525239:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.525245:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.525250:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.525257:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.525269:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782224359.533819:0:6592:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff96eaa7d4c600:6592] 1 exiting: rc = 0 00000100:00100000:0.0:1782224359.538556:0:6591:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff96eaa7d4ce00:6591] 0 exiting: rc = 1 00000100:00100000:3.0:1782224359.538676:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538686:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538691:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538696:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538701:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538708:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538713:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538720:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538724:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538729:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538734:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538739:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538744:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538751:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538757:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538763:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538768:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538773:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538786:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538796:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538801:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538807:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538813:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538819:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.538825:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539000:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539053:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539061:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539069:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539080:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539087:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539092:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539104:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539109:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539114:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539119:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539124:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539130:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539135:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539141:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539149:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539154:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539160:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539165:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539170:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539174:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539202:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539210:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539214:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539220:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539225:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539230:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539236:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539241:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539246:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539373:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539382:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539386:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539392:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539398:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539404:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539416:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539423:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.539428:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782224359.542452:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff96eaa7d4d200:6593] 0 exiting: rc = 1 00000100:00100000:1.0:1782224359.542870:0:6594:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff96ea91c53e00:6594] 1 exiting: rc = 0 00000100:00100000:3.0:1782224359.543205:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543213:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543221:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543227:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543244:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543250:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543277:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543284:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543290:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543297:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543303:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543309:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543314:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543320:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543325:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543330:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543335:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543341:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543358:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543377:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543384:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543390:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543395:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543401:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543407:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543412:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543417:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543423:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543428:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543433:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543452:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543457:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543473:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543478:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543483:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543488:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543493:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543499:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543505:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543510:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543515:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543520:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543539:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543546:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543551:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543558:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543564:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543570:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543576:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543581:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543587:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543592:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543597:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543602:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543619:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543625:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543630:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.543634:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.544455:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.544464:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.544470:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.544476:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.544493:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782224359.544501:0:13168:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1782224359.562400:0:13168:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1782224378.266842:0:13788:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1782224387.601352:0:14201:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782224387.601357:0:14201:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1782224387.601475:0:14201:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff96ea8512c800 00000020:01000004:2.0:1782224387.601491:0:14201:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1782224387.601500:0:14201:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1782224387.601514:0:14201:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff96eabf1999c0) 00000020:00000080:2.0:1782224387.601528:0:14201:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1782224387.633689:0:14201:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1782224387.637541:0:14201:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1782224387.637927:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1782224387.638077:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1782224387.638171:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1782224387.638262:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1782224387.638361:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1782224387.638539:0:14201:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1782224387.638621:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:3.0:1782224387.638864:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1782224387.644311:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 616: rc = 0 00100000:10000000:2.0:1782224387.644426:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 616: rc = 0 00100000:10000000:2.0:1782224387.644974:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 645: rc = 0 00100000:10000000:2.0:1782224387.645456:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1782224387.645806:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1782224387.646266:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 645: rc = 0 00100000:10000000:2.0:1782224387.646508:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 645: rc = 0 00100000:10000000:2.0:1782224387.647067:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1782224387.647395:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1782224387.647647:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 645: rc = 0 00100000:10000000:2.0:1782224387.648224:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 645: rc = 0 00100000:10000000:2.0:1782224387.648490:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1782224387.649129:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1782224387.649410:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 645: rc = 0 00100000:10000000:2.0:1782224387.649937:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 664: rc = 0 00100000:10000000:2.0:1782224387.650307:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 664: rc = 0 00100000:10000000:2.0:1782224387.650552:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 664: rc = 0 00100000:10000000:2.0:1782224387.651361:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 664: rc = 0 00100000:10000000:2.0:1782224387.651633:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 664: rc = 0 00100000:10000000:2.0:1782224387.652280:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 664: rc = 0 00100000:10000000:2.0:1782224387.652515:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 664: rc = 0 00100000:10000000:2.0:1782224387.652756:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 664: rc = 0 00100000:10000000:2.0:1782224387.653697:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 664: rc = 0 00100000:10000000:2.0:1782224387.653949:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 664: rc = 0 00100000:10000000:2.0:1782224387.654240:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 664: rc = 0 00100000:10000000:2.0:1782224387.654468:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 664: rc = 0 00100000:10000000:2.0:1782224387.654744:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 664: rc = 0 00100000:10000000:2.0:1782224387.654997:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 664: rc = 0 00100000:10000000:2.0:1782224387.655285:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 664: rc = 0 00100000:10000000:2.0:1782224387.655538:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 664: rc = 0 00100000:10000000:2.0:1782224387.657892:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 664: rc = 0 00100000:10000000:2.0:1782224387.658363:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 664: rc = 0 00100000:10000000:2.0:1782224387.658639:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 664: rc = 0 00100000:10000000:2.0:1782224387.658899:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 664: rc = 0 00100000:10000000:2.0:1782224387.661643:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 664: rc = 0 00100000:10000000:2.0:1782224387.661932:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 664: rc = 0 00100000:10000000:2.0:1782224387.664634:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 664: rc = 0 00100000:10000000:2.0:1782224387.664955:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 664: rc = 0 00100000:10000000:2.0:1782224387.665843:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 664: rc = 0 00100000:10000000:2.0:1782224387.666155:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 664: rc = 0 00100000:10000000:2.0:1782224387.666413:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 664: rc = 0 00100000:10000000:2.0:1782224387.666675:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 664: rc = 0 00100000:10000000:2.0:1782224387.666938:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 664: rc = 0 00100000:10000000:2.0:1782224387.667224:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 664: rc = 0 00100000:10000000:2.0:1782224387.667464:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 664: rc = 0 00100000:10000000:2.0:1782224387.667722:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 664: rc = 0 00100000:10000000:2.0:1782224387.668122:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 659: rc = 0 00100000:10000000:2.0:1782224387.671417:0:14201:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1782224387.671684:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 491: rc = 0 00100000:10000000:2.0:1782224387.671925:0:14201:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1782224387.671995:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 491: rc = 0 00100000:10000000:3.0:1782224387.672693:0:14201:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1782224387.672772:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 491: rc = 0 00100000:10000000:3.0:1782224387.673269:0:14201:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1782224387.673342:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 617: rc = 0 00100000:10000000:3.0:1782224387.673542:0:14201:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1782224387.673623:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 617: rc = 0 00100000:10000000:3.0:1782224387.673826:0:14201:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1782224387.673896:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 617: rc = 0 00000020:00000080:3.0:1782224387.674437:0:14201:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1782224387.674446:0:14201:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782224387.674459:0:14201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfd8b3ae4b1658d8 00000020:01000004:3.0:1782224387.674468:0:14201:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1782224387.674473:0:14201:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1782224387.674478:0:14201:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96ea8512c800 from MGS 00000020:01000004:3.0:1782224387.674482:0:14201:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1782224387.674493:0:14201:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff96ea83eccd40) 00000020:00000080:3.0:1782224387.674502:0:14201:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1782224387.674558:0:14201:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96ea8512c800 from MGS, refs=2 00080000:01000000:3.0:1782224387.674563:0:14201:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782224387.674568:0:14201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfd8b3ae4b1658e6 00000100:00100000:3.0:1782224387.674677:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1782224387.674798:0:14201:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1782224387.674812:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1782224387.684372:0:14201:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1782224387.684393:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1782224387.685671:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782224387.685858:0:14201:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1782224387.685864:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1782224387.688642:0:14201:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1782224387.688657:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1782224387.689098:0:14201:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1782224387.689104:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1782224387.690382:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224387.690386:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224387.690388:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224387.694534:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224387.694539:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224387.694542:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224387.695322:0:14201:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1782224387.697245:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1782224387.710530:0:14201:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1782224387.710550:0:14201:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782224387.710553:0:14201:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1782224387.723570:0:14210:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1782224387.725524:0:14201:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1782224387.725667:0:14201:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782224387.726566:0:14201:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1782224387.727640:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782224387.728898:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1782224387.728908:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1782224387.729982:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1782224387.729990:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1782224387.730635:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1782224387.730644:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1782224387.732771:0:14201:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1782224387.734471:0:14201:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.202.107@tcp' 00000020:01000004:3.0:1782224387.734475:0:14201:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1782224387.734509:0:14201:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.202.107@tcp (typ=mgc) 00000020:00000080:3.0:1782224387.734526:0:14201:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.107@tcp (ffff96ea83ec8000) 00000020:00000080:3.0:1782224387.734542:0:14201:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1782224387.734651:0:14201:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96eabbbd2800@MGC192.168.202.107@tcp: add connection 192.168.202.107@tcp at head 00010000:00010000:3.0:1782224387.734922:0:14201:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.107@tcp-0 is initialized 00000040:01000000:3.0:1782224387.734929:0:14201:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.107@tcp ctxt 1 is initialized 00000100:00080000:2.0:1782224387.735882:0:14215:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1782224387.736207:0:14216:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1782224387.736320:0:14201:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.107@tcp (uuid fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8) 00000020:00000080:0.0:1782224387.736349:0:14201:0:(genops.c:1406:class_connect()) connect: client fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8, cookie 0xcfd8b3ae4b1658f4 00000100:00080000:0.0:1782224387.736360:0:14201:0:(import.c:512:import_select_connection()) MGC192.168.202.107@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782224387.736366:0:14201:0:(import.c:626:import_select_connection()) MGC192.168.202.107@tcp: import ffff96eabbbd2800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:0.0:1782224387.736395:0:14201:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96eaa7a08380 x1868797333036672/t0(0) o250->MGC192.168.202.107@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782224387.736419:0:14201:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8->MGS 00000020:01000004:0.0:1782224387.736487:0:14201:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1782224387.736492:0:14201:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1782224387.736505:0:14201:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff96ea833bcd40) 00000020:00000080:0.0:1782224387.736515:0:14201:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1782224387.736646:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3302:1868797333036672:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1782224387.736714:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224387.736777:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333036672 00000100:00100000:3.0:1782224387.736794:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333036672 00000100:00100000:3.0:1782224387.736826:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782224387.736833:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1868797333036672:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1782224387.736865:0:14212:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:3.0:1782224387.736886:0:14212:0:(genops.c:1406:class_connect()) connect: client fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8, cookie 0xcfd8b3ae4b165902 00000100:00080000:3.0:1782224387.737003:0:14212:0:(import.c:65:import_set_state_nolock()) ffff96eabbbd7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782224387.737075:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+5:3302:x1868797333036672:12345-0@lo:250:mount.lustre.0 Request processed in 240us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224387.737082:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782224387.737121:0:3302:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.202.107@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1782224387.737128:0:3302:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.202.107@tcp: connect to target with instance 0 00000100:00080000:3.0:1782224387.737135:0:3302:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.202.107@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1782224387.737157:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1782224387.737161:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96eabbbd2800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1782224387.737163:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1782224387.737170:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1782224387.737175:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3302:1868797333036672:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1782224387.758881:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782224387.759143:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1782224387.759151:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1782224387.760603:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1782224387.760614:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1782224387.761845:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1782224387.761854:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1782224387.762691:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782224387.762931:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1782224387.762936:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1782224387.763457:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1782224387.763464:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1782224387.820740:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782224387.822036:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1782224387.822050:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1782224387.823192:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1782224387.823202:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1782224387.824262:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782224387.824419:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782224387.824424:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1782224387.824856:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782224387.824862:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1782224387.825389:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782224387.825502:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782224387.825510:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1782224387.825930:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782224387.825938:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1782224387.826479:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782224387.826604:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1782224387.826608:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1782224387.826935:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782224387.826942:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1782224387.850178:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782224387.850384:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782224387.850390:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1782224387.859299:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782224387.859322:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1782224387.860414:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1782224387.860424:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1782224387.861483:0:14201:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1782224387.861508:0:14201:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1782224387.861515:0:14201:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.107@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1782224387.861671:0:14201:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.107@tcp ctxt 0 is initialized 00000020:01000004:1.0:1782224387.861705:0:14201:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.107@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1782224387.861710:0:14201:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1782224387.861711:0:14201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782224387.861713:0:14201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782224387.861714:0:14201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782224387.861715:0:14201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782224387.861717:0:14201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782224387.861719:0:14201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782224387.861720:0:14201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782224387.861722:0:14201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782224387.861724:0:14201:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782224387.861726:0:14201:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1782224387.861729:0:14201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782224387.861730:0:14201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782224387.861731:0:14201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782224387.861732:0:14201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782224387.861733:0:14201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782224387.861734:0:14201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782224387.861735:0:14201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782224387.861737:0:14201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782224387.861738:0:14201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782224387.861739:0:14201:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782224387.861765:0:14201:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1782224387.861785:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf794700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333036800:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1782224387.861878:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224387.861928:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa7d499c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224387.862057:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333036800 00000100:00100000:0.0:1782224387.862065:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333036800 00000100:00100000:0.0:1782224387.862110:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782224387.862120:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+5:14201:x1868797333036800:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782224387.862171:0:14214:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782224387.862175:0:14214:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1782224387.862178:0:14214:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1782224387.862759:0:14235:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1782224387.863647:0:14214:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1782224387.870417:0:14236:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1782224387.870425:0:14236:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1782224387.870428:0:14236:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1782224387.870464:0:14236:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1782224387.870794:0:14214:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1782224387.870806:0:14214:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1782224387.901263:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+5:14201:x1868797333036800:12345-0@lo:253:mount.lustre.0 Request processed in 39134us (39375us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224387.901284:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782224387.901445:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf794700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333036800:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782224387.901461:0:14201:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782224387.901465:0:14201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782224387.901467:0:14201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782224387.901468:0:14201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782224387.901470:0:14201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782224387.901471:0:14201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782224387.901472:0:14201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782224387.901473:0:14201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782224387.901475:0:14201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782224387.901477:0:14201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782224387.901478:0:14201:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782224387.901498:0:14201:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96ea8512c800 from lustre-MDT0000 10000000:01000000:3.0:1782224387.901529:0:14201:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1782224387.901533:0:14201:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782224387.901537:0:14201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff96ea83ec8000 10000000:01000000:3.0:1782224387.901541:0:14201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782224387.901560:0:14201:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff96ea83ec8000 from 1 10000000:01000000:3.0:1782224387.901563:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782224387.901655:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b165909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224387.901666:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b165909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224387.901675:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b165909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224387.901694:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333036928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782224387.901728:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224387.901769:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc887240 going to sleep for 11 seconds 00000100:00100000:0.0:1782224387.901842:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333036928 00000100:00100000:0.0:1782224387.901860:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333036928 00000100:00100000:0.0:1782224387.901904:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782224387.901913:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+5:14201:x1868797333036928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782224387.901927:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224387.901942:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea88a75600/0xcfd8b3ae4b165910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b165909 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224387.901966:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea88a75600/0xcfd8b3ae4b165910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165909 expref: 6 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224387.901989:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea88a75600/0xcfd8b3ae4b165910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165909 expref: 6 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224387.901998:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a75600, rc 0) 00000100:00100000:0.0:1782224387.902084:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+6:14201:x1868797333036928:12345-0@lo:101:mount.lustre.0 Request processed in 172us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224387.902091:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782224387.902130:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333036928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782224387.902144:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b165909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165910 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224387.902153:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b165909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b165910 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224387.902205:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf794e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333037056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782224387.902232:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224387.902260:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224387.902494:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333037056 00000100:00100000:0.0:1782224387.902500:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333037056 00000100:00100000:0.0:1782224387.902530:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782224387.902537:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+6:14201:x1868797333037056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782224387.902775:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+6:14201:x1868797333037056:12345-0@lo:501:mount.lustre.0 Request processed in 238us (541us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782224387.902782:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782224387.903464:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf794e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333037056:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1782224387.903497:0:14201:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782224387.903520:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b165909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165910 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224387.903530:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b165909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165910 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224387.903539:0:14201:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96ea8512c800 10000000:01000000:1.0:1782224387.903544:0:14201:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782224387.903549:0:14201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff96ea8512c800 10000000:01000000:1.0:1782224387.903551:0:14201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1782224387.903563:0:14201:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff96ea8512c800 from 1 10000000:01000000:1.0:1782224387.903565:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1782224387.903599:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54e00/0xcfd8b3ae4b165917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224387.903607:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54e00/0xcfd8b3ae4b165917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224387.903615:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54e00/0xcfd8b3ae4b165917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224387.903630:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf794e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333037184:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782224387.903666:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224387.903697:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224387.903881:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333037184 00000100:00100000:0.0:1782224387.903886:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333037184 00000100:00100000:0.0:1782224387.903925:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782224387.903933:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+6:14201:x1868797333037184:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782224387.903943:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224387.903956:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea88a74000/0xcfd8b3ae4b16591e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b165917 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224387.903973:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea88a74000/0xcfd8b3ae4b16591e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165917 expref: 7 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224387.903983:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea88a74000/0xcfd8b3ae4b16591e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165917 expref: 7 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224387.904002:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74000, rc 0) 00000100:00100000:0.0:1782224387.904080:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+7:14201:x1868797333037184:12345-0@lo:101:mount.lustre.0 Request processed in 148us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224387.904087:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224387.904650:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf794e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333037184:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782224387.904665:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54e00/0xcfd8b3ae4b165917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16591e expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224387.904674:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54e00/0xcfd8b3ae4b165917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b16591e expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224387.904689:0:14201:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1782224387.904706:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54e00/0xcfd8b3ae4b165917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16591e expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224387.904713:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54e00/0xcfd8b3ae4b165917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16591e expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224387.904720:0:14201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1782224387.904732:0:14201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782224387.904737:0:14201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff96ea8512c800 10000000:01000000:1.0:1782224387.904740:0:14201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1782224387.904744:0:14201:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1782224387.904747:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782224387.904767:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55000/0xcfd8b3ae4b165925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224387.904774:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55000/0xcfd8b3ae4b165925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224387.904782:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55000/0xcfd8b3ae4b165925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224387.904796:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf794e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333037312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782224387.904827:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224387.904865:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224387.904936:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333037312 00000100:00100000:0.0:1782224387.904941:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333037312 00000100:00100000:0.0:1782224387.904979:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782224387.904988:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+7:14201:x1868797333037312:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782224387.904996:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224387.905006:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea88a75c00/0xcfd8b3ae4b16592c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b165925 expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224387.905220:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea88a75c00/0xcfd8b3ae4b16592c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165925 expref: 8 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224387.905230:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea88a75c00/0xcfd8b3ae4b16592c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165925 expref: 8 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224387.905237:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a75c00, rc 0) 00000100:00100000:0.0:1782224387.905283:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+8:14201:x1868797333037312:12345-0@lo:101:mount.lustre.0 Request processed in 296us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224387.905290:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782224387.905527:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf794e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333037312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782224387.905538:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55000/0xcfd8b3ae4b165925 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16592c expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224387.905546:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55000/0xcfd8b3ae4b165925 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b16592c expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224387.905607:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf794e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333037440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782224387.905635:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224387.905662:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224387.905763:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333037440 00000100:00100000:0.0:1782224387.905768:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333037440 00000100:00100000:0.0:1782224387.905801:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782224387.905923:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+8:14201:x1868797333037440:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782224387.909736:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+9:14201:x1868797333037440:12345-0@lo:501:mount.lustre.0 Request processed in 3808us (4093us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224387.909790:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf794e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333037440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782224387.909846:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333037568:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782224387.909910:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224387.909947:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc887900 going to sleep for 11 seconds 00000100:00100000:0.0:1782224387.910258:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333037568 00000100:00100000:0.0:1782224387.910271:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333037568 00000100:00100000:1.0:1782224387.910641:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782224387.914722:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782224387.914747:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+9:14201:x1868797333037568:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782224387.915620:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+9:14201:x1868797333037568:12345-0@lo:503:mount.lustre.0 Request processed in 878us (5705us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224387.915631:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782224387.915704:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333037568:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782224387.916750:0:14237:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14237:1868797333037696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782224387.916819:0:14237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224387.916874:0:14237:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabfbcd300 going to sleep for 11 seconds 00000100:00100000:1.0:1782224387.916943:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333037696 00000100:00100000:1.0:1782224387.916950:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333037696 00000100:00100000:1.0:1782224387.917001:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782224387.917011:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+9:14237:x1868797333037696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782224387.917487:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+9:14237:x1868797333037696:12345-0@lo:502:llog_process_th.0 Request processed in 476us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224387.917496:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782224387.917644:0:14237:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14237:1868797333037696:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782224387.917672:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782224387.917686:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224387.917689:0:14237:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782224387.917697:0:14237:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1782224387.917700:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782224387.917715:0:14237:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff96ea833b99c0) 00000020:00000080:0.0:1782224387.917736:0:14237:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1782224387.917742:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1782224387.917810:0:14237:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1782224387.917823:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfd8b3ae4b16593a 00000020:00000080:0.0:1782224387.918089:0:14237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1782224387.918094:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782224387.918097:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224387.918099:0:14237:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782224387.918102:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782224387.918106:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224387.918107:0:14237:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1782224387.918111:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782224387.918120:0:14237:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff96ea833b8000) 00000020:00000080:0.0:1782224387.918130:0:14237:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1782224387.918142:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1782224387.918145:0:14237:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1782224387.918147:0:14237:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1782224387.918153:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782224387.918203:0:14237:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96ea8512c800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1782224387.918218:0:14237:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff96ea833bb380) 00000020:00000080:0.0:1782224387.918227:0:14237:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1782224387.918272:0:14237:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1782224387.918278:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfd8b3ae4b16594f 00000020:00000080:0.0:1782224387.918374:0:14237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1782224387.918381:0:14237:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1782224387.918385:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcfd8b3ae4b165956 00080000:01000000:0.0:1782224387.918389:0:14237:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1782224387.918393:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfd8b3ae4b16595d 00010000:00010000:0.0:1782224388.031984:0:14237:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1782224388.032573:0:14237:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1782224388.032782:0:14237:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1782224388.033649:0:14237:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff96ea860d8000) 00000020:00000080:0.0:1782224388.033670:0:14237:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1782224388.033745:0:14237:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1782224388.033753:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfd8b3ae4b16596b 00000020:00000080:0.0:1782224388.034416:0:14237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1782224388.042471:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcfd8b3ae4b165972 00000020:00000080:0.0:1782224388.042844:0:14237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1782224388.042854:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782224388.042861:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224388.042863:0:14237:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1782224388.042866:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782224388.042872:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224388.042874:0:14237:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1782224388.042877:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1782224388.042915:0:14237:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1782224388.042940:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782224388.042944:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224388.042945:0:14237:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1782224388.042947:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1782224388.042949:0:14237:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1782224388.042950:0:14237:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782224388.042952:0:14237:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782224388.042954:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1782224388.042956:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224388.042958:0:14237:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1782224388.042960:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782224388.042964:0:14237:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1782224388.042967:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224388.042969:0:14237:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1782224388.042972:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1782224388.042978:0:14237:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.107@tcp to nid 0x20000c0a8ca6b (192.168.202.107@tcp) 00000020:01000000:0.0:1782224388.043007:0:14237:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1782224388.043010:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782224388.043059:0:14237:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff96ea860d99c0) 00000020:00000080:0.0:1782224388.043074:0:14237:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1782224388.043081:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1782224388.043156:0:14237:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1782224388.043162:0:14237:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1782224388.043168:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfd8b3ae4b165980 00010000:00080000:0.0:1782224388.043202:0:14237:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96ea90f45800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.107@tcp at head 00010000:00010000:0.0:1782224388.043455:0:14237:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1782224388.043840:0:14237:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1782224388.043887:0:14237:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1782224388.047845:0:14237:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782224388.047924:0:14237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1782224388.048002:0:14237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1782224388.050920:0:14241:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782224388.050930:0:14241:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1782224388.051727:0:14237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782224388.051746:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782224388.051780:0:14237:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1782224388.051801:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfd8b3ae4b165987 00000100:00080000:0.0:1782224388.051812:0:14237:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782224388.051820:0:14237:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96ea90f45800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:0.0:1782224388.051860:0:14237:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96eaa7a0aa00 x1868797333037824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782224388.051890:0:14237:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1782224388.051977:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333037824:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1782224388.052072:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868797333037824 offset 0 length 520: 4 00000020:01000000:0.0:1782224388.052272:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782224388.052276:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224388.052278:0:14237:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1782224388.052281:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1782224388.052283:0:14237:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1782224388.052285:0:14237:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782224388.052287:0:14237:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782224388.052288:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1782224388.052290:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224388.052291:0:14237:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1782224388.052294:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782224388.052298:0:14237:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1782224388.052301:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224388.052303:0:14237:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1782224388.052306:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1782224388.052309:0:14237:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.107@tcp to nid 0x20000c0a8ca6b (192.168.202.107@tcp) 00000020:01000000:0.0:1782224388.052331:0:14237:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1782224388.052334:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782224388.052347:0:14237:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff96ea860dcd40) 00000020:00000080:0.0:1782224388.052359:0:14237:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1782224388.052363:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1782224388.052432:0:14237:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1782224388.052438:0:14237:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1782224388.052447:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcfd8b3ae4b165995 00010000:00080000:0.0:1782224388.052478:0:14237:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96ea9834f800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.107@tcp at head 00010000:00010000:0.0:1782224388.052695:0:14237:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1782224388.052882:0:14237:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1782224388.052904:0:14237:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1782224388.053562:0:14237:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782224388.053638:0:14237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1782224388.053753:0:14237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1782224388.055373:0:14243:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1782224388.055380:0:14243:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1782224388.056010:0:14237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782224388.056180:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782224388.056217:0:14237:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1782224388.056238:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfd8b3ae4b16599c 00000100:00080000:2.0:1782224388.056249:0:14237:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782224388.056256:0:14237:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96ea9834f800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:2.0:1782224388.056295:0:14237:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96ea8327a680 x1868797333037952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782224388.056368:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333037952:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1782224388.056424:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868797333037952 offset 0 length 520: 4 00000100:00080000:2.0:1782224388.056473:0:14237:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1782224388.056525:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782224388.056529:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224388.056530:0:14237:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1782224388.056533:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782224388.056537:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224388.056538:0:14237:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782224388.056541:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782224388.056542:0:14237:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1782224388.056545:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782224388.056546:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224388.056548:0:14237:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1782224388.056550:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782224388.056552:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224388.056553:0:14237:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782224388.056556:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782224388.056581:0:14237:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83279500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14237:1868797333038080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782224388.056639:0:14237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224388.056669:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333038080 00000100:00100000:2.0:1782224388.056675:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333038080 00000100:00100000:2.0:1782224388.056709:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782224388.056716:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+9:14237:x1868797333038080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782224388.056934:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+9:14237:x1868797333038080:12345-0@lo:502:llog_process_th.0 Request processed in 217us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224388.056942:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782224388.056978:0:14237:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa7a0fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224388.056995:0:14237:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83279500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14237:1868797333038080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782224388.057038:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782224388.057047:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224388.057048:0:14237:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782224388.057051:0:14237:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1782224388.057330:0:14201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1782224388.057348:0:14201:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782224388.057372:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55000/0xcfd8b3ae4b165925 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16592c expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224388.057382:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55000/0xcfd8b3ae4b165925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b16592c expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224388.057389:0:14201:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff96ea8512c800 from 1 10000000:01000000:1.0:1782224388.057392:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782224388.057418:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54000/0xcfd8b3ae4b1659a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224388.057426:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54000/0xcfd8b3ae4b1659a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224388.057434:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54000/0xcfd8b3ae4b1659a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224388.057448:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333038208:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782224388.057484:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224388.057542:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224388.057681:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333038208 00000100:00100000:0.0:1782224388.057686:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333038208 00000100:00100000:0.0:1782224388.057743:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782224388.057752:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+9:14201:x1868797333038208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782224388.057762:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224388.057777:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea88a74600/0xcfd8b3ae4b1659aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1659a3 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.057799:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea88a74600/0xcfd8b3ae4b1659aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1659a3 expref: 10 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.057809:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea88a74600/0xcfd8b3ae4b1659aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1659a3 expref: 10 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.057818:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74600, rc 0) 00000100:00100000:0.0:1782224388.057865:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+10:14201:x1868797333038208:12345-0@lo:101:mount.lustre.0 Request processed in 114us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224388.057872:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782224388.057936:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333038208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782224388.057947:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54000/0xcfd8b3ae4b1659a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1659aa expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224388.057955:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54000/0xcfd8b3ae4b1659a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b1659aa expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224388.058510:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333038336:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1782224388.058556:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224388.058787:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224388.058881:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333038336 00000100:00100000:2.0:1782224388.058887:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333038336 00000100:00100000:2.0:1782224388.058913:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782224388.058921:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+10:14201:x1868797333038336:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1782224388.058938:0:14214:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1782224388.058944:0:14214:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1782224388.059041:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+10:14201:x1868797333038336:12345-0@lo:256:mount.lustre.0 Request processed in 120us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224388.059049:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782224388.059137:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333038336:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1782224388.059694:0:14201:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782224388.059719:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54000/0xcfd8b3ae4b1659a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1659aa expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224388.059730:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54000/0xcfd8b3ae4b1659a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1659aa expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224388.059738:0:14201:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96ea8512c800 from 1 10000000:01000000:1.0:1782224388.059741:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782224388.059768:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54200/0xcfd8b3ae4b1659b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224388.059777:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54200/0xcfd8b3ae4b1659b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224388.059850:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54200/0xcfd8b3ae4b1659b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224388.059870:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333038464:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782224388.059906:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224388.059928:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224388.060104:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333038464 00000100:00100000:2.0:1782224388.060109:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333038464 00000100:00100000:2.0:1782224388.060135:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782224388.060143:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+10:14201:x1868797333038464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782224388.060153:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224388.060168:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbbab600/0xcfd8b3ae4b1659b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1659b1 expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224388.060188:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbbab600/0xcfd8b3ae4b1659b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1659b1 expref: 11 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224388.060198:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbbab600/0xcfd8b3ae4b1659b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1659b1 expref: 11 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224388.060207:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab600, rc 0) 00000100:00100000:2.0:1782224388.060238:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+11:14201:x1868797333038464:12345-0@lo:101:mount.lustre.0 Request processed in 95us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224388.060253:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782224388.060378:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333038464:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782224388.060391:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54200/0xcfd8b3ae4b1659b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1659b8 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224388.060400:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54200/0xcfd8b3ae4b1659b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b1659b8 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224388.060445:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333038592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782224388.060469:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224388.060495:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224388.060539:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333038592 00000100:00100000:2.0:1782224388.060543:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333038592 00000100:00100000:2.0:1782224388.060559:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782224388.060564:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+11:14201:x1868797333038592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782224388.060953:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+11:14201:x1868797333038592:12345-0@lo:501:mount.lustre.0 Request processed in 387us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224388.060960:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782224388.061059:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333038592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782224388.061089:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333038720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782224388.061197:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224388.061214:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224388.061277:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333038720 00000100:00100000:2.0:1782224388.061282:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333038720 00000100:00100000:2.0:1782224388.061299:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782224388.061305:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+11:14201:x1868797333038720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782224388.061455:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+11:14201:x1868797333038720:12345-0@lo:503:mount.lustre.0 Request processed in 149us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224388.061463:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782224388.061546:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333038720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782224388.062578:0:14245:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14245:1868797333038848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782224388.062640:0:14245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224388.062696:0:14245:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782224388.062735:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333038848 00000100:00100000:2.0:1782224388.062740:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333038848 00000100:00100000:2.0:1782224388.062796:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782224388.062805:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+11:14245:x1868797333038848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782224388.062999:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+11:14245:x1868797333038848:12345-0@lo:502:llog_process_th.0 Request processed in 194us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224388.063006:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782224388.063091:0:14245:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14245:1868797333038848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782224388.063127:0:14245:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782224388.063136:0:14245:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224388.063139:0:14245:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782224388.063147:0:14245:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96ea8512c800 00000020:00000080:1.0:1782224388.063150:0:14245:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782224388.063158:0:14245:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782224388.063160:0:14245:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224388.063162:0:14245:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1782224388.063164:0:14245:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782224388.063166:0:14245:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224388.063168:0:14245:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782224388.063171:0:14245:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96ea8512c800 00000020:00000080:1.0:1782224388.063172:0:14245:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782224388.063226:0:14245:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782224388.063229:0:14245:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224388.063230:0:14245:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1782224388.063232:0:14245:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782224388.063234:0:14245:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224388.063235:0:14245:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782224388.063239:0:14245:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96ea8512c800 00000020:00000080:1.0:1782224388.063241:0:14245:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782224388.063268:0:14245:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14245:1868797333038976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782224388.063296:0:14245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224388.066999:0:14245:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88bfdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1782224388.068307:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333038976 00000100:00100000:0.0:1782224388.068320:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333038976 00000100:00100000:0.0:1782224388.068382:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782224388.068392:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+11:14245:x1868797333038976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782224388.068686:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+11:14245:x1868797333038976:12345-0@lo:502:llog_process_th.0 Request processed in 295us (5387us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224388.068694:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782224388.068825:0:14245:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14245:1868797333038976:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782224388.068868:0:14245:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782224388.068877:0:14245:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224388.068879:0:14245:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1782224388.068886:0:14245:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1782224388.070739:0:14201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1782224388.070767:0:14201:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782224388.070799:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54200/0xcfd8b3ae4b1659b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1659b8 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.070812:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54200/0xcfd8b3ae4b1659b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1659b8 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782224388.070862:0:14201:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1782224388.070866:0:14201:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96ea8512c800 10000000:01000000:0.0:1782224388.070869:0:14201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96ea8512c800 10000000:01000000:0.0:1782224388.070873:0:14201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782224388.070879:0:14201:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff96ea8512c800 from 1 10000000:01000000:0.0:1782224388.070882:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782224388.070920:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea88a75e00/0xcfd8b3ae4b1659bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.070929:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea88a75e00/0xcfd8b3ae4b1659bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.070940:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea88a75e00/0xcfd8b3ae4b1659bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224388.070964:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333039104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782224388.071061:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224388.071170:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90e9d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224388.071194:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333039104 00000100:00100000:0.0:1782224388.071200:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333039104 00000100:00100000:0.0:1782224388.071234:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782224388.071242:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+11:14201:x1868797333039104:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782224388.071256:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224388.071268:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea88a74400/0xcfd8b3ae4b1659c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1659bf expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.071291:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea88a74400/0xcfd8b3ae4b1659c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1659bf expref: 12 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.071303:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea88a74400/0xcfd8b3ae4b1659c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1659bf expref: 12 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.071312:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74400, rc 0) 00000100:00100000:0.0:1782224388.071345:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14201:x1868797333039104:12345-0@lo:101:mount.lustre.0 Request processed in 104us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224388.071353:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782224388.071395:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333039104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782224388.071409:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea88a75e00/0xcfd8b3ae4b1659bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1659c6 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.071418:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea88a75e00/0xcfd8b3ae4b1659bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b1659c6 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224388.071463:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333039232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782224388.071495:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224388.071510:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90e9d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224388.071523:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333039232 00000100:00100000:0.0:1782224388.071526:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333039232 00000100:00100000:0.0:1782224388.071542:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782224388.071548:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14201:x1868797333039232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782224388.071819:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14201:x1868797333039232:12345-0@lo:501:mount.lustre.0 Request processed in 270us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224388.071826:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782224388.071856:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333039232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782224388.071885:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333039360:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782224388.071924:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224388.071937:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90e9d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224388.071950:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333039360 00000100:00100000:0.0:1782224388.071953:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333039360 00000100:00100000:0.0:1782224388.071970:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782224388.071977:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14201:x1868797333039360:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782224388.074245:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14201:x1868797333039360:12345-0@lo:503:mount.lustre.0 Request processed in 2259us (2311us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224388.074260:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782224388.074365:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333039360:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782224388.076701:0:14249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14249:1868797333039488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224388.077203:0:14249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224388.077244:0:14249:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc887540 going to sleep for 11 seconds 00000100:00100000:0.0:1782224388.077432:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333039488 00000100:00100000:0.0:1782224388.077440:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333039488 00000100:00100000:0.0:1782224388.077476:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782224388.077482:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14249:x1868797333039488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782224388.077744:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14249:x1868797333039488:12345-0@lo:502:llog_process_th.0 Request processed in 259us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224388.077752:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782224388.077879:0:14249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14249:1868797333039488:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1782224388.077954:0:14249:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1782224388.077970:0:14249:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff96ea83ec99c0) 00000020:00000080:3.0:1782224388.077991:0:14249:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1782224388.079001:0:14249:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96ea8512c800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1782224388.079007:0:14249:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96ea8512c800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1782224388.079010:0:14249:0:(obd_mount.c:701:lustre_put_lsi()) put ffff96ea8512c800 4 00010000:00080000:3.0:1782224388.079057:0:14249:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96ea85d64000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.107@tcp at head 00010000:00010000:3.0:1782224388.083466:0:14249:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1782224388.083574:0:14249:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1782224388.083628:0:14249:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782224388.083642:0:14249:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcfd8b3ae4b1659d4 00000100:00080000:3.0:1782224388.083653:0:14249:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782224388.083660:0:14249:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96ea85d64000 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:3.0:1782224388.083697:0:14249:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96e987c27100 x1868797333039616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782224388.083734:0:14249:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782224388.084912:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868797333039616:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782224388.084994:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224388.085670:0:14249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c26300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14249:1868797333039744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224388.085728:0:14249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224388.085758:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333039744 00000100:00100000:3.0:1782224388.085765:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333039744 00000100:00100000:0.0:1782224388.086001:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333039616 00000100:00100000:0.0:1782224388.086007:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333039616 00000100:00100000:2.0:1782224388.086068:0:14249:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc887540 going to sleep for 11 seconds 00000100:00100000:3.0:1782224388.086273:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782224388.086282:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14249:x1868797333039744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782224388.086546:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14249:x1868797333039744:12345-0@lo:502:llog_process_th.0 Request processed in 263us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224388.086559:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782224388.086649:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782224388.086655:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1868797333039616:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782224388.086721:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1868797333039616:12345-0@lo:38:llog_process_th.0 Request processed in 65us (1727us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782224388.086727:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782224388.086803:0:3302:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782224388.086812:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96ea85d64000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782224388.086816:0:3302:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1782224388.086821:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868797333039616:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782224388.087034:0:14249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c26300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14249:1868797333039744:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1782224388.087063:0:14249:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1782224388.087320:0:14201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1782224388.087407:0:14201:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782224388.087460:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea88a75e00/0xcfd8b3ae4b1659bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1659c6 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.087472:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea88a75e00/0xcfd8b3ae4b1659bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1659c6 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782224388.087520:0:14201:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782224388.087522:0:14201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782224388.087524:0:14201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782224388.087525:0:14201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782224388.087527:0:14201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782224388.087528:0:14201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782224388.087530:0:14201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782224388.087531:0:14201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782224388.087533:0:14201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782224388.087534:0:14201:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782224388.087538:0:14201:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1782224388.087541:0:14201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782224388.087542:0:14201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782224388.087546:0:14201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782224388.087547:0:14201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782224388.087548:0:14201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782224388.087549:0:14201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782224388.087550:0:14201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782224388.087551:0:14201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782224388.087552:0:14201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782224388.087553:0:14201:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782224388.087580:0:14201:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1782224388.087607:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333039872:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1782224388.087650:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224388.087681:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90e9d840 going to sleep for 11 seconds 00000100:00100000:0.0:1782224388.087697:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333039872 00000100:00100000:0.0:1782224388.087701:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333039872 00000100:00100000:0.0:1782224388.087740:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782224388.087748:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14201:x1868797333039872:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782224388.087773:0:14213:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1782224388.087900:0:14213:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1782224388.166942:0:14213:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782224388.166970:0:14213:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1782224388.167399:0:14235:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782224388.167435:0:14235:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782224388.167469:0:14235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224388.167493:0:14235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea88a74600/0xcfd8b3ae4b1659aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1659a3 expref: 12 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224388.167504:0:14235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659db lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224388.167566:0:14235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea88a74600/0xcfd8b3ae4b1659aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b1659a3 expref: 12 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224388.167595:0:14235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96ea88a74600/0xcfd8b3ae4b1659aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659a3 expref: 12 pid: 14213 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224388.167616:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14235:1868797333040000:0@lo:104: 00000100:00100000:1.0:1782224388.167711:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224388.167778:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea832b0840 going to sleep for 11 seconds 00000100:00100000:3.0:1782224388.168066:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333040000 00000100:00100000:3.0:1782224388.168078:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333040000 00000100:00100000:3.0:1782224388.168161:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782224388.168178:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf795500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+3:14235:x1868797333040000:12345-0@lo:104: 00010000:00010000:3.0:1782224388.168194:0:14202:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54000/0xcfd8b3ae4b1659a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1659aa expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224388.168519:0:14202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782224388.168529:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf795500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+3:14235:x1868797333040000:12345-0@lo:104: Request processed in 357us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224388.168538:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1782224388.168572:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782224388.168580:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54000/0xcfd8b3ae4b1659a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1659aa expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224388.168593:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf797100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14235:1868797333040000:0@lo:104: 00010000:00010000:3.0:1782224388.168606:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54000 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:3.0:1782224388.168614:0:14208:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54000/0xcfd8b3ae4b1659a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b1659aa expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224388.168625:0:14208:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54000/0xcfd8b3ae4b1659a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b1659aa expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.168632:0:14235:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782224388.168661:0:14208:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54000/0xcfd8b3ae4b1659a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b1659aa expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224388.168669:0:14208:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782224388.168717:0:14208:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54000/0xcfd8b3ae4b1659a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1659aa expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224388.168724:0:14208:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782224388.168803:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3304:1868797333040128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782224388.168818:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54000/0xcfd8b3ae4b1659a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1659aa expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224388.168829:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54000/0xcfd8b3ae4b1659a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1659aa expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224388.168849:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224388.168851:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224388.168853:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224388.168872:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224388.169063:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333040128 00000100:00100000:0.0:1782224388.169072:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333040128 00010000:00010000:0.0:1782224388.169107:0:14204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea88a74600/0xcfd8b3ae4b1659aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659a3 expref: 13 pid: 14213 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224388.169140:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782224388.169168:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+13:3304:x1868797333040128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782224388.169184:0:14204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224388.169192:0:14204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea88a74600/0xcfd8b3ae4b1659aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659a3 expref: 13 pid: 14213 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.169205:0:14204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea88a74600/0xcfd8b3ae4b1659aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659a3 expref: 13 pid: 14213 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.169223:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea88a74600/0xcfd8b3ae4b1659aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659a3 expref: 13 pid: 14213 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.169453:0:14204:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659db lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.169462:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782224388.169480:0:14204:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002046000s 00010000:00010000:0.0:1782224388.169486:0:14204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.169494:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.169502:0:14204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.169510:0:14204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.169516:0:14204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54a00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224388.169530:0:14204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.169540:0:14204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659db lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.169565:0:14204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659db lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224388.169575:0:14204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224388.169612:0:14235:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224388.169624:0:14235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224388.169630:0:14235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659db lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224388.169644:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:3304:x1868797333040128:12345-0@lo:103:ldlm_bl.0 Request processed in 475us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224388.169654:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782224388.169696:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3304:1868797333040128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782224388.183208:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+11:14201:x1868797333039872:12345-0@lo:253:mount.lustre.0 Request processed in 95445us (95541us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224388.183229:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782224388.183510:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14201:1868797333039872:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782224388.183529:0:14201:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1782224388.183533:0:14201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782224388.183535:0:14201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782224388.183536:0:14201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782224388.183537:0:14201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782224388.183538:0:14201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782224388.183539:0:14201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782224388.183541:0:14201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782224388.183543:0:14201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782224388.183545:0:14201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782224388.183547:0:14201:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782224388.183567:0:14201:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1782224388.194736:0:14201:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1782224388.195045:0:14201:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1782224388.195345:0:14201:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1782224388.195503:0:14201:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1782224388.195790:0:14201:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1782224388.195958:0:14201:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1782224388.198055:0:14201:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1782224388.198516:0:14201:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1782224388.198798:0:14201:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1782224388.199246:0:14201:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1782224388.199539:0:14201:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1782224388.199703:0:14201:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1782224388.248493:0:14201:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1782224388.251152:0:14201:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1782224388.251441:0:14258:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1782224388.251446:0:14258:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1782224388.251750:0:14259:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1782224388.251873:0:14259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782224388.256842:0:14259:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1782224388.256930:0:14259:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1782224388.256934:0:14259:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1782224388.262074:0:14201:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1782224388.262298:0:14201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1782224388.262758:0:14201:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1782224388.262767:0:14201:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1782224388.262902:0:14201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782224388.267224:0:14201:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1782224388.267887:0:14201:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1782224388.267922:0:14201:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1782224388.274208:0:14201:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1782224388.283420:0:14201:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1782224388.327337:0:14201:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1782224388.327384:0:14201:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb3d501c8b988 00100000:10000000:0.0:1782224388.327394:0:14201:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1782224388.332375:0:14201:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782224388.332392:0:14201:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.107@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782224388.332414:0:14201:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1782224388.332431:0:14201:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1782224388.758724:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782224389.140703:0:14253:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1782224389.524542:0:14216:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782224389.524548:0:14216:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff96ea8512c800 from 6 10000000:01000000:2.0:1782224389.524553:0:14216:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782224389.524617:0:14216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa600/0xcfd8b3ae4b1659e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224389.524629:0:14216:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa600/0xcfd8b3ae4b1659e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224389.524639:0:14216:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa600/0xcfd8b3ae4b1659e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224389.524665:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333040256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782224389.524733:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224389.524783:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea83194600 going to sleep for 11 seconds 00000100:00100000:3.0:1782224389.524830:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333040256 00000100:00100000:3.0:1782224389.524838:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333040256 00000100:00100000:3.0:1782224389.524893:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782224389.524903:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+11:14216:x1868797333040256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782224389.524916:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224389.524932:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b1659e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1659e2 expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224389.524957:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b1659e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1659e2 expref: 12 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224389.524984:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b1659e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1659e2 expref: 12 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224389.524992:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675600, rc 0) 00000100:00100000:3.0:1782224389.525059:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14216:x1868797333040256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224389.525066:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782224389.525196:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333040256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782224389.525211:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa600/0xcfd8b3ae4b1659e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1659e9 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224389.525220:0:14216:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa600/0xcfd8b3ae4b1659e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b1659e9 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224389.525267:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333040384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1782224389.525307:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224389.525334:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea83194600 going to sleep for 11 seconds 00000100:00100000:0.0:1782224389.525427:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333040384 00000100:00100000:0.0:1782224389.525432:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333040384 00000100:00100000:0.0:1782224389.525465:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782224389.525473:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14216:x1868797333040384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782224389.525487:0:14213:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782224389.525504:0:14213:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782224389.525507:0:14213:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1782224389.525603:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14216:x1868797333040384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224389.525620:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782224389.525708:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333040384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1782224389.525758:0:14216:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782224389.525764:0:14216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa600/0xcfd8b3ae4b1659e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1659e9 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224389.525772:0:14216:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa600/0xcfd8b3ae4b1659e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b1659e9 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224389.781006:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782224390.164737:0:14253:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782224390.804615:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224391.830195:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224392.853281:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782224392.918772:0:14502:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1782224393.300504:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782224393.300512:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782224393.300515:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782224393.300518:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782224393.300521:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782224393.300524:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782224393.300528:0:37:0:(import.c:65:import_set_state_nolock()) ffff96ea85d64000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782224393.300550:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96ea85d64000 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:3.0:1782224393.300573:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96e987c26a00 x1868797333040640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782224393.300609:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868797333040640:0@lo:38:kworker.0 00000100:00100000:3.0:1782224393.300679:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224393.300843:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782224393.300855:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3306:1868797333040512:0@lo:400:kworker.0 00000100:00100000:1.0:1782224393.300891:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224393.301079:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333040640 00000100:00100000:2.0:1782224393.301088:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333040640 00000100:00100000:2.0:1782224393.301123:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782224393.301131:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1868797333040640:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1782224393.301157:0:14221:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:2.0:1782224393.301193:0:14221:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcfd8b3ae4b1659f0 00000004:00100000:2.0:1782224393.301208:0:14221:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782224393.301332:0:14221:0:(import.c:65:import_set_state_nolock()) ffff96ea83331000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782224393.301394:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1868797333040640:12345-0@lo:38:kworker.0 Request processed in 263us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224393.301401:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782224393.301611:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333040512 00000100:00100000:3.0:1782224393.301616:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333040512 00000100:00100000:3.0:1782224393.301657:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782224393.301664:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:3306:x1868797333040512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224393.301723:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:3306:x1868797333040512:12345-0@lo:400:kworker.0 Request processed in 60us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224393.301729:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1782224393.301771:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96e987c26a00 x1868797333040640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782224403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782224393.301785:0:3302:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1782224393.301792:0:3302:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1782224393.301797:0:3302:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782224393.301799:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96ea85d64000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782224393.301805:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1868797333040640:0@lo:38:kworker.0 00000100:00100000:2.0:1782224393.301884:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3306:1868797333040512:0@lo:400:kworker.0 00010000:00010000:0.0:1782224393.879311:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224394.900387:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782224395.855867:0:14652:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb8ca58f0 20000000:00000080:3.0:1782224395.855886:0:14652:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96ea916ffc00 uarg=0000000000000000 20000000:01000000:3.0:1782224395.855924:0:14652:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1782224395.855933:0:14652:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1782224395.855937:0:14652:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1782224395.857539:0:14653:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1782224395.857815:0:14652:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1782224395.893760:0:14652:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782224395.893818:0:14652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b1659f7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224395.894425:0:14652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96eabbbab600/0xcfd8b3ae4b1659b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1659b1 expref: 11 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224395.894443:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b1659f7 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224395.894804:0:14652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96eabbbab600/0xcfd8b3ae4b1659b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b1659b1 expref: 11 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224395.894824:0:14652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96eabbbab600/0xcfd8b3ae4b1659b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659b1 expref: 11 pid: 14214 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224395.894840:0:14652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14652:1868797333040768:0@lo:104: 00000100:00100000:2.0:1782224395.894927:0:14652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224395.894987:0:14652:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea904f2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782224395.895080:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333040768 00000100:00100000:3.0:1782224395.895088:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333040768 00000100:00100000:3.0:1782224395.895155:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782224395.895165:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83278700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+3:14652:x1868797333040768:12345-0@lo:104: 00010000:00010000:3.0:1782224395.895178:0:14202:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54200/0xcfd8b3ae4b1659b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1659b8 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224395.895252:0:14202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782224395.895259:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83278700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+3:14652:x1868797333040768:12345-0@lo:104: Request processed in 96us (332us total) trans 0 rc 0/0 00010000:00010000:0.0:1782224395.895263:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1782224395.895269:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1782224395.895272:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54200/0xcfd8b3ae4b1659b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1659b8 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224395.895283:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54200 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:0.0:1782224395.895288:0:14208:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54200/0xcfd8b3ae4b1659b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b1659b8 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224395.895298:0:14208:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54200/0xcfd8b3ae4b1659b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b1659b8 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782224395.895306:0:14208:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54200/0xcfd8b3ae4b1659b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b1659b8 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782224395.895312:0:14208:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782224395.895354:0:14208:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54200/0xcfd8b3ae4b1659b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1659b8 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224395.895360:0:14208:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782224395.895383:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54200/0xcfd8b3ae4b1659b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1659b8 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224395.895391:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54200/0xcfd8b3ae4b1659b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1659b8 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224395.895409:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224395.895418:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224395.895420:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224395.895434:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3306:1868797333040896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782224395.895466:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224395.895548:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333040896 00000100:00100000:0.0:1782224395.895552:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333040896 00010000:00010000:0.0:1782224395.895573:0:14205:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96eabbbab600/0xcfd8b3ae4b1659b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659b1 expref: 12 pid: 14214 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224395.895603:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782224395.895610:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:3306:x1868797333040896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782224395.895620:0:14205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224395.895625:0:14205:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96eabbbab600/0xcfd8b3ae4b1659b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659b1 expref: 12 pid: 14214 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224395.895634:0:14205:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96eabbbab600/0xcfd8b3ae4b1659b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659b1 expref: 12 pid: 14214 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224395.895665:0:14205:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b1659f7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224395.895673:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b1659f7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224395.895687:0:14205:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b1659f7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224395.895693:0:14205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b1659f7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224395.895700:0:14205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b1659f7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224395.895713:0:14205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b1659f7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224395.895719:0:14205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675a00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224395.895723:0:14205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b1659f7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224395.895731:0:14205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b1659f7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224395.895740:0:14205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b1659f7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224395.895750:0:14205:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224395.895787:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:3306:x1868797333040896:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224395.895795:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782224395.895819:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3306:1868797333040896:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782224395.895872:0:14652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabbbab600/0xcfd8b3ae4b1659b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659b1 expref: 11 pid: 14214 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224395.895884:0:14652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14652:1868797333040768:0@lo:104: 00010000:00010000:1.0:1782224395.895899:0:14652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b1659f7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224395.895908:0:14652:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b1659f7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224395.895914:0:14652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b1659f7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224395.895930:0:14652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90675a00/0xcfd8b3ae4b1659f7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224395.924166:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224396.950163:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782224396.950404:0:14216:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782224396.950408:0:14216:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96ea8512c800 from 10 10000000:01000000:1.0:1782224396.950414:0:14216:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782224396.950457:0:14216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224396.950469:0:14216:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224396.950481:0:14216:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224396.950520:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333041024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782224396.950587:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224396.950637:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc221900 going to sleep for 11 seconds 00000100:00100000:3.0:1782224396.950684:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333041024 00000100:00100000:3.0:1782224396.950691:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333041024 00000100:00100000:3.0:1782224396.950744:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782224396.950754:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+11:14216:x1868797333041024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782224396.950769:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224396.950782:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea90675c00/0xcfd8b3ae4b165a05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b1659fe expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224396.950806:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90675c00/0xcfd8b3ae4b165a05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1659fe expref: 12 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224396.950817:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea90675c00/0xcfd8b3ae4b165a05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1659fe expref: 12 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224396.950827:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675c00, rc 0) 00000100:00100000:3.0:1782224396.950873:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14216:x1868797333041024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224396.950881:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782224396.950954:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333041024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782224396.950969:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165a05 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224396.950978:0:14216:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b165a05 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224396.951061:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333041152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782224396.951087:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224396.951118:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc221900 going to sleep for 11 seconds 00000100:00100000:3.0:1782224396.951233:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333041152 00000100:00100000:3.0:1782224396.951244:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333041152 00000100:00100000:3.0:1782224396.951274:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782224396.951281:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14216:x1868797333041152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224396.951521:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14216:x1868797333041152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224396.951529:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782224396.951662:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333041152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782224396.951690:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333041280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782224396.951730:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224396.951756:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc221900 going to sleep for 11 seconds 00000100:00100000:0.0:1782224396.951816:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333041280 00000100:00100000:0.0:1782224396.951821:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333041280 00000100:00100000:0.0:1782224396.951852:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782224396.951859:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14216:x1868797333041280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782224396.952011:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14216:x1868797333041280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224396.952130:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333041280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782224396.952345:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000040:00080000:3.0:1782224396.959884:0:14683:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1782224396.960195:0:14216:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1782224396.960219:0:14216:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782224396.960232:0:14216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165a05 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224396.960245:0:14216:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165a05 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224397.973685:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782224398.421481:0:13809:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782224398.421502:0:13809:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782224398.421505:0:13809:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782224398.421516:0:13809:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782224398.421553:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3303:1868797333041408:0@lo:400:kworker.0 00000100:00100000:0.0:1782224398.421637:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224398.421699:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782224398.421705:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797333041536:0@lo:400:kworker.0 00000100:00100000:1.0:1782224398.421743:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333041408 00000100:00100000:0.0:1782224398.421744:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224398.421753:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333041408 00000100:00100000:0.0:1782224398.421783:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333041536 00000100:00100000:0.0:1782224398.421788:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333041536 00000100:00100000:1.0:1782224398.421804:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782224398.421814:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:3303:x1868797333041408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224398.421836:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782224398.421847:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797333041536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224398.421865:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:3303:x1868797333041408:12345-0@lo:400:kworker.0 Request processed in 53us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224398.421871:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782224398.421893:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797333041536:12345-0@lo:400:kworker.0 Request processed in 47us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224398.421901:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782224398.421991:0:3302:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782224388/real 1782224388] req@ffff96ea8327a680 x1868797333037952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782224398 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224398.422046:0:3302:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96ea8327a680 x1868797333037952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782224398 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224398.422057:0:3302:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782224388/real 1782224388] req@ffff96eaa7a0aa00 x1868797333037824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782224398 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224398.422072:0:3302:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96eaa7a0aa00 x1868797333037824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782224398 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782224398.422086:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96ea9834f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782224398.422100:0:3302:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782224398.422104:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333037952:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1782224398.422110:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96ea90f45800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782224398.422116:0:3302:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782224398.422121:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333037824:0@lo:8:llog_process_th.0 00010000:00080000:1.0:1782224398.422165:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96eaa7a0a300 x1868797333041536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224398.422177:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797333041536:0@lo:400:kworker.0 00000100:00100000:1.0:1782224398.422186:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3303:1868797333041408:0@lo:400:kworker.0 00000100:00080000:0.0:1782224398.422914:0:13809:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782224398.422921:0:13809:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1782224398.422924:0:13809:0:(import.c:65:import_set_state_nolock()) ffff96ea90f45800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782224398.422929:0:13809:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 468 00000100:00080000:0.0:1782224398.422934:0:13809:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782224398.422940:0:13809:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96ea90f45800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:0.0:1782224398.422964:0:13809:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96eaa7a09f80 x1868797333041664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782224398.422988:0:13809:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782224398.422992:0:13809:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782224398.422994:0:13809:0:(import.c:65:import_set_state_nolock()) ffff96ea9834f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782224398.422997:0:13809:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 468 00000100:00080000:0.0:1782224398.423008:0:13809:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782224398.423028:0:13809:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96ea9834f800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:0.0:1782224398.423042:0:13809:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96eaa7a0a300 x1868797333041792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782224398.423460:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333041664:0@lo:8:kworker.0 00000400:00000100:1.0:1782224398.423527:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868797333041664 offset 0 length 520: 4 00000100:00100000:1.0:1782224398.423684:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333041792:0@lo:8:kworker.0 00000400:00000100:1.0:1782224398.423712:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868797333041792 offset 0 length 520: 4 00010000:00010000:3.0:1782224398.997269:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224400.026525:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782224400.145514:0:14853:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782224400.145519:0:14853:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1782224400.145650:0:14853:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff96ea9c4a6000 00000020:01000004:0.0:1782224400.145669:0:14853:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1782224400.145685:0:14853:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1782224400.145701:0:14853:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff96ea860db380) 00000020:00000080:0.0:1782224400.145719:0:14853:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1782224400.166449:0:14853:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1782224400.166796:0:14853:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1782224400.167820:0:14853:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1782224400.168187:0:14853:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1782224400.168503:0:14853:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1782224400.168913:0:14853:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 371: rc = 0 00100000:10000000:0.0:1782224400.169005:0:14853:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 371: rc = 0 00100000:10000000:0.0:1782224400.169152:0:14853:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 371: rc = 0 00100000:10000000:0.0:1782224400.169834:0:14853:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 119: rc = 0 00100000:10000000:1.0:1782224400.170593:0:14853:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 119: rc = 0 00100000:10000000:1.0:1782224400.170882:0:14853:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 119: rc = 0 00100000:10000000:1.0:1782224400.171676:0:14853:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 119: rc = 0 00100000:10000000:1.0:1782224400.171954:0:14853:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 119: rc = 0 00100000:10000000:1.0:1782224400.172503:0:14853:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 119: rc = 0 00000020:00000080:1.0:1782224400.173431:0:14853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1782224400.173447:0:14853:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782224400.173467:0:14853:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcfd8b3ae4b165a13 00000020:01000004:1.0:1782224400.173490:0:14853:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1782224400.173523:0:14853:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.107@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1782224400.173527:0:14853:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.107@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1782224400.173535:0:14853:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1782224400.173542:0:14853:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1782224400.173559:0:14853:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff96ea83efb380) 00000020:00000080:1.0:1782224400.173576:0:14853:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1782224400.176715:0:14853:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782224400.176959:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1782224400.176967:0:14853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1782224400.178721:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1782224400.178732:0:14853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1782224400.179262:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1782224400.179273:0:14853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1782224400.186123:0:14853:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782224400.186332:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1782224400.186411:0:14853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1782224400.187781:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1782224400.187795:0:14853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1782224400.229137:0:14853:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782224400.229408:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782224400.229415:0:14853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1782224400.230962:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782224400.231080:0:14853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1782224400.236980:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1782224400.237003:0:14853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1782224400.243650:0:14853:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782224400.244330:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1782224400.244340:0:14853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1782224400.248007:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1782224400.248046:0:14853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1782224400.362114:0:14853:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782224400.362313:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1782224400.362320:0:14853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1782224400.378423:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1782224400.378442:0:14853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1782224400.379243:0:14853:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1782224400.379270:0:14853:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1782224400.379277:0:14853:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.107@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:00080000:2.0:1782224400.407846:0:14253:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:01000000:2.0:1782224400.410818:0:14853:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.107@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782224400.410858:0:14853:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.107@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1782224400.410863:0:14853:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782224400.410864:0:14853:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782224400.410866:0:14853:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782224400.410867:0:14853:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782224400.410868:0:14853:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782224400.410870:0:14853:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782224400.410872:0:14853:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782224400.410873:0:14853:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782224400.410875:0:14853:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782224400.410879:0:14853:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1782224400.410882:0:14853:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782224400.410883:0:14853:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782224400.410885:0:14853:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782224400.410886:0:14853:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782224400.410887:0:14853:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782224400.410888:0:14853:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782224400.410889:0:14853:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782224400.410890:0:14853:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782224400.410891:0:14853:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782224400.410931:0:14853:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782224400.410953:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333041920:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782224400.411071:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224400.411116:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea889aa540 going to sleep for 11 seconds 00000100:00100000:0.0:1782224400.411286:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333041920 00000100:00100000:0.0:1782224400.411294:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333041920 00000100:00100000:0.0:1782224400.411358:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782224400.411367:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14853:x1868797333041920:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782224400.411408:0:14212:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1782224400.411412:0:14212:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1782224400.411416:0:14212:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1782224400.417251:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14853:x1868797333041920:12345-0@lo:253:mount.lustre.0 Request processed in 5876us (6171us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224400.417267:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782224400.417618:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333041920:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782224400.417636:0:14853:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782224400.417639:0:14853:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782224400.417640:0:14853:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782224400.417642:0:14853:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782224400.417643:0:14853:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782224400.417644:0:14853:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782224400.417645:0:14853:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782224400.417647:0:14853:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782224400.417648:0:14853:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782224400.417650:0:14853:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782224400.417669:0:14853:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96ea9c4a6000 from lustre-OST0000 10000000:01000000:2.0:1782224400.417693:0:14853:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1782224400.417696:0:14853:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1782224400.417703:0:14853:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96ea83ec8000 local copy 00010000:00010000:2.0:1782224400.417714:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b165909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165910 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224400.417962:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333042048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782224400.418168:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224400.418208:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8508e180 going to sleep for 11 seconds 00000100:00100000:1.0:1782224400.419465:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333042048 00000100:00100000:1.0:1782224400.419486:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333042048 00000100:00100000:1.0:1782224400.419551:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782224400.419563:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14853:x1868797333042048:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782224400.419812:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14853:x1868797333042048:12345-0@lo:501:mount.lustre.0 Request processed in 250us (1643us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782224400.419821:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782224400.419845:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333042048:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1782224400.419865:0:14853:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.107@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1782224400.419987:0:14853:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.107@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1782224400.419995:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b165909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165910 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224400.420004:0:14853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b165909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165910 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224400.420068:0:14853:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96ea9c4a6000 10000000:01000000:2.0:1782224400.420073:0:14853:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782224400.420079:0:14853:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff96ea83ec8000 10000000:01000000:2.0:1782224400.420082:0:14853:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1782224400.420086:0:14853:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff96ea83ec8000 from 1 10000000:01000000:2.0:1782224400.420089:0:14853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782224400.420119:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbbabc00/0xcfd8b3ae4b165a21 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224400.420128:0:14853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabbbabc00/0xcfd8b3ae4b165a21 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224400.420137:0:14853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabbbabc00/0xcfd8b3ae4b165a21 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224400.420154:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333042176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782224400.420191:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224400.420226:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8508e180 going to sleep for 11 seconds 00000100:00100000:0.0:1782224400.420237:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333042176 00000100:00100000:0.0:1782224400.420244:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333042176 00000100:00100000:0.0:1782224400.420278:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782224400.420285:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+12:14853:x1868797333042176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782224400.420294:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224400.420309:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea88a74200/0xcfd8b3ae4b165a28 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b165a21 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224400.420331:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea88a74200/0xcfd8b3ae4b165a28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165a21 expref: 13 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224400.420353:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea88a74200/0xcfd8b3ae4b165a28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165a21 expref: 13 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224400.420362:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74200, rc 0) 00000100:00100000:0.0:1782224400.420414:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+13:14853:x1868797333042176:12345-0@lo:101:mount.lustre.0 Request processed in 130us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224400.420420:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782224400.420576:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333042176:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782224400.420589:0:14853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabbbabc00/0xcfd8b3ae4b165a21 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165a28 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.420598:0:14853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabbbabc00/0xcfd8b3ae4b165a21 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b165a28 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224400.420615:0:14853:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782224400.420633:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbbabc00/0xcfd8b3ae4b165a21 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165a28 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.420641:0:14853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabbbabc00/0xcfd8b3ae4b165a21 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165a28 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224400.420648:0:14853:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782224400.420652:0:14853:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782224400.420658:0:14853:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1782224400.420661:0:14853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782224400.420674:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b165a2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.420682:0:14853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b165a2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.420690:0:14853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b165a2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224400.420704:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333042304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782224400.420733:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224400.420767:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc221a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782224400.421064:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333042304 00000100:00100000:2.0:1782224400.421070:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333042304 00000100:00100000:2.0:1782224400.421139:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782224400.421147:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+13:14853:x1868797333042304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782224400.421155:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224400.421164:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbbaa800/0xcfd8b3ae4b165a36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b165a2f expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224400.421179:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbbaa800/0xcfd8b3ae4b165a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165a2f expref: 14 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224400.421199:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbbaa800/0xcfd8b3ae4b165a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165a2f expref: 14 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224400.421206:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaa800, rc 0) 00000100:00100000:2.0:1782224400.421246:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+14:14853:x1868797333042304:12345-0@lo:101:mount.lustre.0 Request processed in 100us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224400.421252:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782224400.421318:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333042304:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782224400.421328:0:14853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b165a2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165a36 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.421347:0:14853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b165a2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b165a36 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782224400.422007:0:14853:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1782224400.422873:0:14853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782224400.423144:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1782224400.423187:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1782224400.423217:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1782224400.423265:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1782224400.423299:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1782224400.423330:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1782224400.423389:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1782224400.423396:0:14853:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1782224400.423500:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333042432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782224400.423566:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224400.433352:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc221e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782224400.438587:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333042432 00000100:00100000:0.0:1782224400.438601:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333042432 00000100:00100000:0.0:1782224400.438666:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782224400.438675:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf73a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+14:14853:x1868797333042432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782224400.439158:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf73a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+14:14853:x1868797333042432:12345-0@lo:501:mount.lustre.0 Request processed in 484us (15591us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224400.439167:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782224400.439358:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333042432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782224400.439414:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333042560:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782224400.439478:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224400.439504:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc221e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782224400.439673:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333042560 00000100:00100000:2.0:1782224400.439678:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333042560 00000100:00100000:3.0:1782224400.439771:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782224400.439778:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf73b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+14:14853:x1868797333042560:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782224400.440163:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf73b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+14:14853:x1868797333042560:12345-0@lo:503:mount.lustre.0 Request processed in 385us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224400.440177:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782224400.440236:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333042560:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1782224400.441186:0:14853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782224400.441259:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83279c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333042688:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782224400.441313:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224400.441342:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8508e240 going to sleep for 11 seconds 00000100:00100000:3.0:1782224400.441784:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333042688 00000100:00100000:3.0:1782224400.441791:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333042688 00000100:00100000:3.0:1782224400.441829:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782224400.441837:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf73a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+14:14853:x1868797333042688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782224400.442124:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf73a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+14:14853:x1868797333042688:12345-0@lo:502:mount.lustre.0 Request processed in 286us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224400.442132:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782224400.442355:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83279c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333042688:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782224400.442641:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1782224400.442687:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1782224400.442729:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1782224400.442774:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1782224400.442805:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1782224400.442832:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1782224400.442874:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1782224400.442910:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1782224400.442943:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1782224400.442990:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1782224400.443049:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1782224400.443095:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1782224400.443134:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83279c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333042816:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782224400.443196:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224400.443228:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8508e240 going to sleep for 11 seconds 00000100:00100000:3.0:1782224400.444195:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333042816 00000100:00100000:3.0:1782224400.444206:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333042816 00000100:00100000:3.0:1782224400.444245:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782224400.444254:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf73bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+14:14853:x1868797333042816:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782224400.444560:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf73bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+14:14853:x1868797333042816:12345-0@lo:502:mount.lustre.0 Request processed in 306us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224400.444568:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782224400.445097:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83279c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333042816:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782224400.445217:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1782224400.445232:0:14853:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1782224400.448532:0:14867:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782224400.448543:0:14867:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1782224400.448553:0:14867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224400.448556:0:14867:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1782224400.448562:0:14867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782224400.448578:0:14867:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff96eabf198000) 00000020:00000080:2.0:1782224400.448603:0:14867:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1782224400.448609:0:14867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782224400.448695:0:14867:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96ea9c4a6000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1782224400.448703:0:14867:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782224400.448713:0:14867:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcfd8b3ae4b165a44 00010000:00010000:3.0:1782224400.452391:0:14867:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1782224400.452879:0:14867:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1782224400.455562:0:14867:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1782224400.456836:0:14867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1782224400.456849:0:14867:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782224400.456856:0:14867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224400.456859:0:14867:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1782224400.456863:0:14867:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1782224400.456866:0:14867:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1782224400.456868:0:14867:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782224400.456870:0:14867:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782224400.456872:0:14867:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1782224400.456874:0:14867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224400.456882:0:14867:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1782224400.456885:0:14867:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782224400.456890:0:14867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224400.456891:0:14867:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782224400.456894:0:14867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782224400.456896:0:14867:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1782224400.456898:0:14867:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782224400.456901:0:14867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224400.456902:0:14867:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1782224400.456905:0:14867:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782224400.456907:0:14867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224400.456908:0:14867:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782224400.456911:0:14867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1782224400.456966:0:14867:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782224400.456970:0:14867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782224400.456971:0:14867:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782224400.456974:0:14867:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1782224400.462853:0:14853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1782224400.462899:0:14853:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782224400.462927:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b165a2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165a36 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224400.462943:0:14853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea90674600/0xcfd8b3ae4b165a2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165a36 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224400.462953:0:14853:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96ea9c4a6000 from 1 10000000:01000000:1.0:1782224400.462956:0:14853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782224400.463120:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55e00/0xcfd8b3ae4b165a4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224400.463130:0:14853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55e00/0xcfd8b3ae4b165a4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224400.463142:0:14853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55e00/0xcfd8b3ae4b165a4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224400.463167:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf794380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333042944:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782224400.463238:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224400.463314:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8352ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1782224400.463850:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333042944 00000100:00100000:3.0:1782224400.463859:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333042944 00000100:00100000:3.0:1782224400.463908:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782224400.463917:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+14:14853:x1868797333042944:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782224400.463932:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224400.463944:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b165a52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b165a4b expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.463971:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b165a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165a4b expref: 15 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.464198:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b165a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165a4b expref: 15 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.464209:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674400, rc 0) 00000100:00100000:1.0:1782224400.464369:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+15:14853:x1868797333042944:12345-0@lo:101:mount.lustre.0 Request processed in 451us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224400.464377:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782224400.464439:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf794380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333042944:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782224400.464455:0:14853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55e00/0xcfd8b3ae4b165a4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165a52 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224400.464464:0:14853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55e00/0xcfd8b3ae4b165a4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b165a52 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782224400.465451:0:14853:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1782224400.465880:0:14853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782224400.466388:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1782224400.466422:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1782224400.466457:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1782224400.466462:0:14853:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1782224400.466552:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333043072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782224400.466632:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224400.466744:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea91c3fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782224400.466797:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333043072 00000100:00100000:1.0:1782224400.466806:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333043072 00000100:00100000:1.0:1782224400.466893:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782224400.466903:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf73b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+15:14853:x1868797333043072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782224400.467179:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf73b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+15:14853:x1868797333043072:12345-0@lo:501:mount.lustre.0 Request processed in 277us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224400.467185:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782224400.467256:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333043072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782224400.467288:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83279c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333043200:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782224400.467326:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224400.467604:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8508e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224400.467659:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333043200 00000100:00100000:0.0:1782224400.467663:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333043200 00000100:00100000:0.0:1782224400.467685:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782224400.467689:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+15:14853:x1868797333043200:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782224400.467799:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+15:14853:x1868797333043200:12345-0@lo:503:mount.lustre.0 Request processed in 109us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224400.467806:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782224400.467869:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83279c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333043200:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1782224400.468247:0:14853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782224400.468292:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83279c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333043328:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782224400.468319:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224400.468336:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8508e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224400.468518:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333043328 00000100:00100000:0.0:1782224400.468522:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333043328 00000100:00100000:0.0:1782224400.468540:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782224400.468546:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf73b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+15:14853:x1868797333043328:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782224400.468651:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf73b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+15:14853:x1868797333043328:12345-0@lo:502:mount.lustre.0 Request processed in 106us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224400.468656:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782224400.468718:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83279c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333043328:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782224400.468887:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1782224400.468915:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1782224400.468942:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1782224400.468961:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1782224400.468989:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1782224400.469052:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1782224400.469081:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1782224400.469112:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1782224400.469129:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83279c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333043456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782224400.469156:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224400.469176:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8508e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224400.469269:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333043456 00000100:00100000:0.0:1782224400.469273:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333043456 00000100:00100000:0.0:1782224400.469287:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782224400.469291:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+15:14853:x1868797333043456:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782224400.469399:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+15:14853:x1868797333043456:12345-0@lo:502:mount.lustre.0 Request processed in 107us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224400.469404:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782224400.469542:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83279c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333043456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782224400.469607:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1782224400.469614:0:14853:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1782224400.471524:0:14871:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782224400.471539:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224400.471541:0:14871:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782224400.471552:0:14871:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96ea9c4a6000 00000020:00000080:0.0:1782224400.471554:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782224400.471565:0:14871:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782224400.471567:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224400.471569:0:14871:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1782224400.471572:0:14871:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782224400.471587:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224400.471588:0:14871:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782224400.471592:0:14871:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96ea9c4a6000 00000020:00000080:0.0:1782224400.471594:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782224400.471675:0:14871:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782224400.471680:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224400.471681:0:14871:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1782224400.471684:0:14871:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782224400.471686:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224400.471688:0:14871:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782224400.471691:0:14871:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96ea9c4a6000 00000020:00000080:0.0:1782224400.471693:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782224400.471732:0:14871:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782224400.471735:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224400.471736:0:14871:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1782224400.471739:0:14871:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1782224400.475134:0:14853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1782224400.475196:0:14853:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782224400.475258:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55e00/0xcfd8b3ae4b165a4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165a52 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.475273:0:14853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55e00/0xcfd8b3ae4b165a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165a52 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224400.475340:0:14853:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782224400.475344:0:14853:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96ea9c4a6000 10000000:01000000:3.0:1782224400.475348:0:14853:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96ea9c4a6000 10000000:01000000:3.0:1782224400.475353:0:14853:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782224400.475359:0:14853:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff96ea9c4a6000 from 1 10000000:01000000:3.0:1782224400.475363:0:14853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782224400.475403:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675a00/0xcfd8b3ae4b165a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.475413:0:14853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea90675a00/0xcfd8b3ae4b165a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.475425:0:14853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea90675a00/0xcfd8b3ae4b165a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224400.475451:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c24380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333043584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782224400.475552:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224400.475587:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333043584 00000100:00100000:0.0:1782224400.475597:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333043584 00000100:00100000:3.0:1782224400.475599:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8508e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224400.475652:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782224400.475664:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf73ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+15:14853:x1868797333043584:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782224400.475684:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224400.475702:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea88a74c00/0xcfd8b3ae4b165a60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b165a59 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224400.475734:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea88a74c00/0xcfd8b3ae4b165a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165a59 expref: 16 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224400.475747:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea88a74c00/0xcfd8b3ae4b165a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165a59 expref: 16 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224400.475755:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea88a74c00, rc 0) 00000100:00100000:0.0:1782224400.475808:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf73ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:14853:x1868797333043584:12345-0@lo:101:mount.lustre.0 Request processed in 145us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224400.475822:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782224400.475844:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c24380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333043584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782224400.475861:0:14853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea90675a00/0xcfd8b3ae4b165a59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165a60 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.475882:0:14853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea90675a00/0xcfd8b3ae4b165a59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b165a60 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782224400.476585:0:14853:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1782224400.476882:0:14853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782224400.477184:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1782224400.477230:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1782224400.477265:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1782224400.477310:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1782224400.477342:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1782224400.477382:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1782224400.477428:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1782224400.477456:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1782224400.477513:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1782224400.477545:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1782224400.477573:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1782224400.477610:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1782224400.477638:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1782224400.477665:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1782224400.477726:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1782224400.477759:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1782224400.477785:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1782224400.477823:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1782224400.477852:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1782224400.477878:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1782224400.477914:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1782224400.477942:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1782224400.477983:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1782224400.478049:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1782224400.478083:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1782224400.478111:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1782224400.478171:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1782224400.478205:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1782224400.478274:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1782224400.478282:0:14853:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1782224400.478380:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c24380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333043712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782224400.478446:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224400.478495:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8508e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224400.478801:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333043712 00000100:00100000:0.0:1782224400.478810:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333043712 00000100:00100000:0.0:1782224400.478856:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782224400.478865:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:14853:x1868797333043712:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782224400.479111:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:14853:x1868797333043712:12345-0@lo:501:mount.lustre.0 Request processed in 246us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224400.479120:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782224400.481674:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c24380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333043712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782224400.481740:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c24380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333043840:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782224400.481817:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224400.482091:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8508e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224400.487908:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333043840 00000100:00100000:2.0:1782224400.487925:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333043840 00000100:00100000:3.0:1782224400.488189:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782224400.488200:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf73a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:14853:x1868797333043840:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782224400.488668:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf73a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:14853:x1868797333043840:12345-0@lo:503:mount.lustre.0 Request processed in 468us (6850us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224400.488677:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782224400.488759:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c24380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333043840:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782224400.493761:0:14853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782224400.493853:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333043968:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782224400.493933:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224400.495930:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea9825a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224400.498273:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333043968 00000100:00100000:2.0:1782224400.498285:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333043968 00000100:00100000:0.0:1782224400.499175:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782224400.499187:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:14853:x1868797333043968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782224400.499643:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:14853:x1868797333043968:12345-0@lo:502:mount.lustre.0 Request processed in 457us (5709us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224400.499653:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782224400.500114:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333043968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782224400.500408:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1782224400.501171:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1782224400.501235:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1782224400.501294:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1782224400.501331:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1782224400.501379:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1782224400.501415:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1782224400.501447:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1782224400.501510:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1782224400.501546:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1782224400.501601:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1782224400.501661:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1782224400.501701:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1782224400.501734:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1782224400.501779:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1782224400.501811:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1782224400.501840:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1782224400.501904:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1782224400.501940:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1782224400.501969:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1782224400.502060:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1782224400.502095:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1782224400.502126:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1782224400.502170:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1782224400.502202:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1782224400.502230:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1782224400.502298:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1782224400.502334:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1782224400.502365:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1782224400.502408:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1782224400.502442:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1782224400.502486:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1782224400.502520:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1782224400.502578:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1782224400.502618:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1782224400.502663:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1782224400.502696:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1782224400.502728:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1782224400.502770:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1782224400.502802:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1782224400.502853:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333044096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782224400.502934:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224400.503676:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea85cfe000 going to sleep for 11 seconds 00000100:00100000:1.0:1782224400.503722:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333044096 00000100:00100000:1.0:1782224400.503731:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333044096 00000100:00100000:2.0:1782224400.503798:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782224400.503810:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:14853:x1868797333044096:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782224400.504102:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:14853:x1868797333044096:12345-0@lo:502:mount.lustre.0 Request processed in 293us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224400.504112:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782224400.504274:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333044096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782224400.504370:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1782224400.504384:0:14853:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1782224400.505408:0:14876:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1782224400.505424:0:14876:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff96eabf19b380) 00000020:00000080:2.0:1782224400.505445:0:14876:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1782224400.505642:0:14876:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96ea9c4a6000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782224400.505648:0:14876:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96ea9c4a6000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782224400.505651:0:14876:0:(obd_mount.c:701:lustre_put_lsi()) put ffff96ea9c4a6000 3 00010000:00080000:2.0:1782224400.505681:0:14876:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96eabfcb5800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.107@tcp at head 00010000:00010000:2.0:1782224400.507360:0:14876:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1782224400.507485:0:14876:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1782224400.507523:0:14876:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782224400.507535:0:14876:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcfd8b3ae4b165a6e 00000100:00080000:2.0:1782224400.507546:0:14876:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782224400.507553:0:14876:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96eabfcb5800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:2.0:1782224400.507589:0:14876:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96ea83279c00 x1868797333044224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782224400.507621:0:14876:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1782224400.507653:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782224400.507658:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782224400.507661:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782224400.507665:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782224400.507706:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782224400.507718:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797333044352:0@lo:400:kworker.0 00000100:00100000:2.0:1782224400.507792:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224400.508100:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1868797333044224:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782224400.508136:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224400.509760:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333044352 00000100:00100000:2.0:1782224400.509777:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333044352 00000100:00100000:2.0:1782224400.509827:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333044224 00000100:00100000:2.0:1782224400.509830:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333044224 00000100:00100000:2.0:1782224400.509846:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782224400.509856:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8327ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797333044352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224400.509949:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8327ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797333044352:12345-0@lo:400:kworker.0 Request processed in 94us (2156us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224400.509964:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782224400.510719:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782224400.510727:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1868797333044224:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1782224400.510754:0:14220:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 481 last 0 00000100:00100000:2.0:1782224400.510837:0:14219:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1782224400.510847:0:14219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:2.0:1782224400.510894:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96ea8327aa00 x1868797333044352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224400.510910:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797333044352:0@lo:400:kworker.0 00000040:00080000:3.0:1782224400.514359:0:14876:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1782224400.514515:0:14853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1782224400.514545:0:14853:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782224400.514565:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675a00/0xcfd8b3ae4b165a59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165a60 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.514579:0:14853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea90675a00/0xcfd8b3ae4b165a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165a60 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782224400.514636:0:14853:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782224400.514638:0:14853:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782224400.514640:0:14853:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782224400.514642:0:14853:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782224400.514643:0:14853:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782224400.514645:0:14853:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782224400.514647:0:14853:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782224400.514649:0:14853:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782224400.514650:0:14853:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782224400.514654:0:14853:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1782224400.514657:0:14853:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782224400.514658:0:14853:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782224400.514660:0:14853:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782224400.514661:0:14853:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782224400.514662:0:14853:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782224400.514663:0:14853:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782224400.514665:0:14853:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782224400.514666:0:14853:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782224400.514667:0:14853:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782224400.514695:0:14853:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1782224400.514717:0:14853:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333044480:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782224400.514796:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224400.514834:0:14853:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea85cfe000 going to sleep for 11 seconds 00000020:00000080:1.0:1782224400.515224:0:14220:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcfd8b3ae4b165a75 00000004:00100000:1.0:1782224400.515242:0:14220:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782224400.515328:0:14220:0:(import.c:65:import_set_state_nolock()) ffff96ea82a33800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782224400.515485:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333044480 00000100:00100000:0.0:1782224400.515492:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333044480 00000100:00100000:0.0:1782224400.515573:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782224400.515583:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:14853:x1868797333044480:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782224400.515610:0:14212:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1782224400.515623:0:14212:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1782224400.516531:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1868797333044224:12345-0@lo:38:llog_process_th.0 Request processed in 5799us (8390us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224400.516544:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782224400.518063:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96ea83279c00 x1868797333044224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782224410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224400.518081:0:3302:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782224400.518092:0:3302:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1782224400.518103:0:3302:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782224400.518110:0:3302:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782224400.518114:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96eabfcb5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782224400.518122:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1868797333044224:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1782224400.543945:0:14212:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782224400.544061:0:14212:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1782224400.550342:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:14853:x1868797333044480:12345-0@lo:253:mount.lustre.0 Request processed in 34749us (35535us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224400.550358:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782224400.550463:0:14853:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14853:1868797333044480:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782224400.550493:0:14853:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1782224400.550497:0:14853:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782224400.550499:0:14853:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782224400.550500:0:14853:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782224400.550501:0:14853:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782224400.550503:0:14853:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782224400.550505:0:14853:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782224400.550506:0:14853:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782224400.550508:0:14853:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782224400.550509:0:14853:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782224400.550523:0:14853:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1782224400.551126:0:14235:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782224400.551133:0:14235:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782224400.556705:0:14235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96ea88a74e00/0xcfd8b3ae4b165a7c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224400.556731:0:14235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b1659e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1659e2 expref: 15 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224400.556740:0:14235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96ea88a74e00/0xcfd8b3ae4b165a7c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224400.556789:0:14235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b1659e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b1659e2 expref: 15 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224400.556803:0:14235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b1659e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659e2 expref: 15 pid: 14214 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224400.556819:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14235:1868797333044608:0@lo:104: 00000100:00100000:0.0:1782224400.556893:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:3.0:1782224400.557438:0:14853:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1782224400.557619:0:14853:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1782224400.557781:0:14853:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1782224400.557925:0:14853:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00000100:00100000:0.0:1782224400.558128:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90cace40 going to sleep for 11 seconds 00080000:10000000:3.0:1782224400.558459:0:14853:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1782224400.558703:0:14853:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1782224400.559865:0:14853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1782224400.564175:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333044608 00000100:00100000:1.0:1782224400.564188:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333044608 00000100:00100000:1.0:1782224400.564248:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782224400.564259:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+3:14235:x1868797333044608:12345-0@lo:104: 00010000:00010000:1.0:1782224400.564290:0:14202:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa600/0xcfd8b3ae4b1659e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1659e9 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224400.564387:0:14202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782224400.564393:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+3:14235:x1868797333044608:12345-0@lo:104: Request processed in 137us (7500us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224400.564402:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782224400.564445:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14235:1868797333044608:0@lo:104: 00010000:00010000:1.0:1782224400.564479:0:14235:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96ea88a74e00/0xcfd8b3ae4b165a7c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.567510:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782224400.567525:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa600/0xcfd8b3ae4b1659e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b1659e9 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.567537:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa600 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:3.0:1782224400.567542:0:14208:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa600/0xcfd8b3ae4b1659e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b1659e9 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.567553:0:14208:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa600/0xcfd8b3ae4b1659e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b1659e9 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782224400.567574:0:14208:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa600/0xcfd8b3ae4b1659e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b1659e9 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224400.567581:0:14208:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782224400.567637:0:14208:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa600/0xcfd8b3ae4b1659e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1659e9 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.567644:0:14208:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782224400.567668:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa600/0xcfd8b3ae4b1659e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1659e9 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.567676:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa600/0xcfd8b3ae4b1659e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b1659e9 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.567695:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224400.567697:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224400.567699:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224400.567727:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3306:1868797333044736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782224400.567806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224400.567878:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333044736 00000100:00100000:3.0:1782224400.567885:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333044736 00010000:00010000:3.0:1782224400.567911:0:14206:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b1659e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659e2 expref: 16 pid: 14214 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224400.567938:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782224400.567946:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:3306:x1868797333044736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782224400.567961:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224400.567966:0:14206:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b1659e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659e2 expref: 16 pid: 14214 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.567984:0:14206:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b1659e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659e2 expref: 16 pid: 14214 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.567999:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90675600/0xcfd8b3ae4b1659e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659e2 expref: 16 pid: 14214 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.568046:0:14206:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96ea88a74e00/0xcfd8b3ae4b165a7c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.568056:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea88a74e00/0xcfd8b3ae4b165a7c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782224400.568072:0:14206:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016940255s 00010000:00010000:3.0:1782224400.568078:0:14206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea88a74e00/0xcfd8b3ae4b165a7c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.568086:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea88a74e00/0xcfd8b3ae4b165a7c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.568093:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96ea88a74e00/0xcfd8b3ae4b165a7c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.568101:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96ea88a74e00/0xcfd8b3ae4b165a7c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.568108:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74e00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224400.568112:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96ea88a74e00/0xcfd8b3ae4b165a7c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.568120:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96ea88a74e00/0xcfd8b3ae4b165a7c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.568140:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96ea88a74e00/0xcfd8b3ae4b165a7c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.568151:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224400.568184:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+15:3306:x1868797333044736:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224400.568192:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782224400.568235:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3306:1868797333044736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782224400.568260:0:14235:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96ea88a74e00/0xcfd8b3ae4b165a7c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.568268:0:14235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96ea88a74e00/0xcfd8b3ae4b165a7c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224400.568275:0:14235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea88a74e00/0xcfd8b3ae4b165a7c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1782224400.604530:0:14853:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1782224400.604541:0:14853:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1782224400.604580:0:14853:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782224400.604651:0:14853:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.107@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782224400.604665:0:14853:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1782224400.604694:0:14853:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1782224401.048187:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224402.069177:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782224402.516289:0:14216:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782224402.516297:0:14216:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff96ea8512c800 from 7 10000000:01000000:1.0:1782224402.516301:0:14216:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782224402.516351:0:14216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55600/0xcfd8b3ae4b165a83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224402.516364:0:14216:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55600/0xcfd8b3ae4b165a83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224402.516376:0:14216:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55600/0xcfd8b3ae4b165a83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224402.516404:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf795f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333044864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782224402.516488:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224402.516539:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabfca1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782224402.516887:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333044864 00000100:00100000:3.0:1782224402.516897:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333044864 00000100:00100000:3.0:1782224402.516957:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782224402.516969:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+15:14216:x1868797333044864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782224402.516985:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224402.516999:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b165a8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b165a83 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224402.517043:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b165a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165a83 expref: 16 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224402.517067:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b165a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165a83 expref: 16 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224402.517077:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675200, rc 0) 00000100:00100000:3.0:1782224402.517899:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:14216:x1868797333044864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 929us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224402.517910:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782224402.518095:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf795f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333044864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782224402.518114:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55600/0xcfd8b3ae4b165a83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165a8a expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224402.518135:0:14216:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55600/0xcfd8b3ae4b165a83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b165a8a expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224402.518194:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333044992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1782224402.518229:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224402.518306:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90cac840 going to sleep for 11 seconds 00000100:00100000:3.0:1782224402.520416:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333044992 00000100:00100000:3.0:1782224402.520429:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333044992 00000100:00100000:3.0:1782224402.520500:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782224402.520510:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:14216:x1868797333044992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1782224402.520535:0:14212:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782224402.520551:0:14212:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782224402.520554:0:14212:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1782224402.520684:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:14216:x1868797333044992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 176us (2454us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224402.520693:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782224402.520863:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333044992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782224402.520930:0:14216:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782224402.520940:0:14216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55600/0xcfd8b3ae4b165a83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165a8a expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224402.520953:0:14216:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55600/0xcfd8b3ae4b165a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165a8a expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224403.092237:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224404.116180:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224405.141255:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782224405.560672:0:15220:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1782224405.589407:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782224405.589414:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782224405.589417:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782224405.589432:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782224405.589478:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3303:1868797333045120:0@lo:400:kworker.0 00000100:00100000:2.0:1782224405.589542:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224405.590880:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224405.590896:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797333045248:0@lo:400:kworker.0 00000100:00100000:2.0:1782224405.590945:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224405.590996:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797333045376:0@lo:400:kworker.0 00000100:00100000:2.0:1782224405.591042:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224405.591079:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333045120 00000100:00100000:2.0:1782224405.591086:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333045120 00000100:00100000:2.0:1782224405.591129:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782224405.591138:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:3303:x1868797333045120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224405.591191:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:3303:x1868797333045120:12345-0@lo:400:kworker.0 Request processed in 53us (1648us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224405.591199:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782224405.591231:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333045248 00000100:00100000:2.0:1782224405.591234:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333045248 00000100:00100000:2.0:1782224405.591258:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333045376 00000100:00100000:2.0:1782224405.591261:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333045376 00000100:00100000:2.0:1782224405.591290:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782224405.591295:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797333045248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224405.591326:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797333045248:12345-0@lo:400:kworker.0 Request processed in 31us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224405.591331:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782224405.591342:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782224405.591348:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797333045376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224405.591374:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797333045376:12345-0@lo:400:kworker.0 Request processed in 26us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224405.591380:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1782224405.591413:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782224405.592394:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96ea8327a300 x1868797333045376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224405.592412:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797333045376:0@lo:400:kworker.0 00010000:00080000:2.0:1782224405.596376:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96ea8327aa00 x1868797333045248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224405.596396:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797333045248:0@lo:400:kworker.0 00000100:00100000:2.0:1782224405.596410:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3303:1868797333045120:0@lo:400:kworker.0 00010000:00010000:3.0:1782224406.164141:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224407.204581:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224408.212188:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224409.246329:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224410.260195:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782224410.647157:0:14253:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1782224410.709737:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782224410.709744:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782224410.709747:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782224410.709751:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782224410.710680:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3306:1868797333045504:0@lo:400:kworker.0 00000100:00100000:2.0:1782224410.710764:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224410.710828:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797333045632:0@lo:400:kworker.0 00000100:00100000:2.0:1782224410.710870:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224410.710898:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224410.710904:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333045760:0@lo:400:kworker.0 00000100:00100000:2.0:1782224410.710928:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224410.710967:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333045504 00000100:00100000:1.0:1782224410.710968:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333045632 00000100:00100000:2.0:1782224410.710974:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333045504 00000100:00100000:1.0:1782224410.710974:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333045632 00000100:00100000:1.0:1782224410.711012:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333045760 00000100:00100000:1.0:1782224410.711029:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333045760 00000100:00100000:1.0:1782224410.711059:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224410.711069:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797333045632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224410.711120:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797333045632:12345-0@lo:400:kworker.0 Request processed in 53us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224410.711128:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224410.711143:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782224410.711149:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8327aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333045760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224410.711176:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8327aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333045760:12345-0@lo:400:kworker.0 Request processed in 27us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224410.711181:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782224410.711271:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782224410.711504:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:3306:x1868797333045504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224410.712071:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:3306:x1868797333045504:12345-0@lo:400:kworker.0 Request processed in 791us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224410.712079:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1782224410.712103:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782224410.712124:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eaa7a09c00 x1868797333045760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224410.712138:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333045760:0@lo:400:kworker.0 00000100:00100000:1.0:1782224410.712640:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3306:1868797333045504:0@lo:400:kworker.0 00010000:00080000:2.0:1782224410.713086:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eaa7a08a80 x1868797333045632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224410.713096:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797333045632:0@lo:400:kworker.0 00010000:00010000:1.0:1782224411.285349:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224412.317677:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224413.338637:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224413.847379:0:3302:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782224398/real 1782224398] req@ffff96eaa7a09f80 x1868797333041664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782224413 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224413.847409:0:3302:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96eaa7a09f80 x1868797333041664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782224413 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224413.847418:0:3302:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782224398/real 1782224398] req@ffff96eaa7a0a300 x1868797333041792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782224413 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224413.847430:0:3302:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96eaa7a0a300 x1868797333041792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782224413 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782224413.847460:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96ea90f45800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782224413.847474:0:3302:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782224413.847478:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333041664:0@lo:8:kworker.0 00000100:00080000:1.0:1782224413.847484:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96ea9834f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782224413.847489:0:3302:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782224413.847492:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333041792:0@lo:8:kworker.0 00000100:00080000:2.0:1782224413.850433:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782224413.850439:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1782224413.850442:0:36:0:(import.c:65:import_set_state_nolock()) ffff96ea90f45800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782224413.850450:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 479 00000100:00080000:2.0:1782224413.850455:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782224413.850461:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96ea90f45800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:2.0:1782224413.850480:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96ea83279180 x1868797333046016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782224413.850495:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782224413.850498:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782224413.850500:0:36:0:(import.c:65:import_set_state_nolock()) ffff96ea9834f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782224413.850503:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 479 00000100:00080000:2.0:1782224413.850505:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782224413.850509:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96ea9834f800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:2.0:1782224413.850518:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96ea83278380 x1868797333046144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782224413.850563:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3305:1868797333045888:0@lo:400:kworker.0 00000100:00100000:2.0:1782224413.850628:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224413.850670:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782224413.850676:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333046272:0@lo:400:kworker.0 00000100:00100000:2.0:1782224413.850699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224413.850733:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83279180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333046016:0@lo:8:kworker.0 00000100:00100000:2.0:1782224413.850973:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224413.850995:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333046144:0@lo:8:kworker.0 00000100:00100000:2.0:1782224413.851047:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224413.851072:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333046400:0@lo:400:kworker.0 00000100:00100000:2.0:1782224413.856875:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224413.859221:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333045888 00000100:00100000:2.0:1782224413.859234:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333045888 00000100:00100000:1.0:1782224413.859453:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333046016 00000100:00100000:1.0:1782224413.859458:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333046016 00000100:00100000:1.0:1782224413.859487:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333046144 00000100:00100000:1.0:1782224413.859490:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333046144 00000100:00100000:1.0:1782224413.859503:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782224413.859510:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8327b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1868797333046016:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1782224413.859539:0:14854:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:1.0:1782224413.859571:0:14854:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfd8b3ae4b165a91 00002000:00100000:1.0:1782224413.859585:0:14854:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff96ea916d5000 ocd_connect_flags: 0xe044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1782224413.859590:0:14854:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1782224413.859592:0:14854:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1782224413.860748:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782224413.860758:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:3305:x1868797333045888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224413.860846:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:3305:x1868797333045888:12345-0@lo:400:kworker.0 Request processed in 89us (10217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224413.860853:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782224413.860886:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333046272 00000100:00100000:2.0:1782224413.860891:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333046272 00000100:00100000:2.0:1782224413.860924:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333046400 00000100:00100000:2.0:1782224413.860927:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333046400 00000100:00100000:2.0:1782224413.860950:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782224413.860955:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8327b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333046272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224413.860986:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8327b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333046272:12345-0@lo:400:kworker.0 Request processed in 30us (10286us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224413.860993:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782224413.861002:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782224413.861007:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333046400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224413.861066:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333046400:12345-0@lo:400:kworker.0 Request processed in 58us (4199us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224413.861081:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1782224413.861136:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96ea8327b800 x1868797333046272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224413.861153:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333046272:0@lo:400:kworker.0 00000100:00100000:2.0:1782224413.861165:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3305:1868797333045888:0@lo:400:kworker.0 00010000:00080000:2.0:1782224413.861447:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96ea8327a680 x1868797333046400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224413.861457:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333046400:0@lo:400:kworker.0 00002000:00080000:1.0:1782224413.864374:0:14854:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782224413.864411:0:14854:0:(import.c:65:import_set_state_nolock()) ffff96ea916d0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782224413.864496:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8327b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1868797333046016:12345-0@lo:8:kworker.0 Request processed in 4985us (13732us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224413.864506:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782224413.864534:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782224413.864540:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1868797333046144:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1782224413.864557:0:14854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1782224413.864593:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1868797333046144:12345-0@lo:8:kworker.0 Request processed in 52us (13545us total) trans 0 rc -19/-19 00000100:00100000:1.0:1782224413.864599:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1782224413.864734:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782224413.868054:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96ea83279180 x1868797333046016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782224433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224413.868070:0:3302:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782224413.868079:0:3302:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1782224413.868089:0:3302:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xe040401443000026 00000100:00080000:2.0:1782224413.868095:0:3302:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1782224413.868099:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96ea90f45800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782224413.868122:0:3302:0:(osp_dev.c:1650:osp_import_event()) got connected 00000100:00100000:2.0:1782224413.868129:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83279180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333046016:0@lo:8:kworker.0 00000100:00080000:2.0:1782224413.868145:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96ea9834f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782224413.868150:0:3302:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782224413.868153:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333046144:0@lo:8:kworker.0 00000004:00080000:0.0:1782224413.868463:0:14242:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1782224413.868484:0:14242:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14242:1868797333046656:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1782224413.868543:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224413.868588:0:14242:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90caca80 going to sleep for 11 seconds 00000100:00100000:0.0:1782224413.868609:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333046656 00000100:00100000:0.0:1782224413.868614:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333046656 00000100:00100000:0.0:1782224413.868661:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782224413.868669:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14242:x1868797333046656:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1782224413.869405:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333046528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782224413.869443:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1782224413.871311:0:14241:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1782224413.871610:0:14241:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 494651594187ns, next at 0ns, rc = 0 00000100:00080000:1.0:1782224413.874080:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782224413.876857:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333046528 00000100:00100000:1.0:1782224413.876868:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333046528 00000100:00100000:1.0:1782224413.876921:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782224413.876933:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1868797333046528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782224413.876966:0:14858:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224413.877055:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1868797333046528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (7611us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224413.877062:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1782224413.879110:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eaa7a0b800 x1868797333046528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224413.879133:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333046528:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1782224413.899415:0:14854:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1782224413.899427:0:14854:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1782224413.899433:0:14854:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:0.0:1782224413.922895:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.922908:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065ea1c9b/0xcfd8b3ae4b165a98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.922926:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.922931:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.922938:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065ea1c9b/0xcfd8b3ae4b165a98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.922955:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065ea1c9b/0xcfd8b3ae4b165a98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.922967:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065ea1c9b/0xcfd8b3ae4b165a98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.922975:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065ea1c9b/0xcfd8b3ae4b165a98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.922992:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782224413.923427:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.923438:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045afbbc6/0xcfd8b3ae4b165a9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.923447:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.923451:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.923455:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045afbbc6/0xcfd8b3ae4b165a9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.923465:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045afbbc6/0xcfd8b3ae4b165a9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.923473:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045afbbc6/0xcfd8b3ae4b165a9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.923480:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045afbbc6/0xcfd8b3ae4b165a9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.923493:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1782224413.923828:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.923834:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd3572e1/0xcfd8b3ae4b165aa6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.923843:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.923845:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.923849:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd3572e1/0xcfd8b3ae4b165aa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.923858:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd3572e1/0xcfd8b3ae4b165aa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.923872:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd3572e1/0xcfd8b3ae4b165aa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.923880:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd3572e1/0xcfd8b3ae4b165aa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.923888:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1782224413.924254:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.924260:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b165aad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.924268:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.924271:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.924275:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b165aad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.924285:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b165aad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.924293:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b165aad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.924301:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b165aad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.924319:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1782224413.930360:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782224413.930374:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065ea1c9b/0xcfd8b3ae4b165a98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930401:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224413.930406:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065ea1c9b/0xcfd8b3ae4b165a98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930418:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065ea1c9b/0xcfd8b3ae4b165a98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930441:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065ea1c9b/0xcfd8b3ae4b165a98 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930449:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065ea1c9b/0xcfd8b3ae4b165a98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930474:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782224413.930478:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045afbbc6/0xcfd8b3ae4b165a9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930484:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74800 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224413.930488:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045afbbc6/0xcfd8b3ae4b165a9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930495:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045afbbc6/0xcfd8b3ae4b165a9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930505:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045afbbc6/0xcfd8b3ae4b165a9f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930516:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045afbbc6/0xcfd8b3ae4b165a9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930528:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782224413.930531:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd3572e1/0xcfd8b3ae4b165aa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930538:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74e00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224413.930541:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd3572e1/0xcfd8b3ae4b165aa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930549:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd3572e1/0xcfd8b3ae4b165aa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930557:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd3572e1/0xcfd8b3ae4b165aa6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930564:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd3572e1/0xcfd8b3ae4b165aa6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930573:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782224413.930577:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b165aad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930584:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74600 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224413.930590:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b165aad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930599:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b165aad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930608:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b165aad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930614:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073f0b4ec/0xcfd8b3ae4b165aad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224413.930625:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224413.930627:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224413.930628:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224413.930680:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224413.939305:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.939317:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165ab4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.939333:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.939337:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.939356:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165ab4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.939371:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165ab4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.939381:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165ab4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.939389:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165ab4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.939414:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224413.939429:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224413.939434:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165ab4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.939441:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a74a00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224413.939479:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165ab4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.939489:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165ab4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.939506:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165ab4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.939514:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8053d0b/0xcfd8b3ae4b165ab4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.939533:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.939535:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.939536:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224413.940739:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.940747:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006462816d/0xcfd8b3ae4b165abb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.940757:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.940771:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.940776:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006462816d/0xcfd8b3ae4b165abb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.940786:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006462816d/0xcfd8b3ae4b165abb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.940796:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006462816d/0xcfd8b3ae4b165abb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.940809:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006462816d/0xcfd8b3ae4b165abb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.940824:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224413.940834:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224413.940839:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006462816d/0xcfd8b3ae4b165abb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.940846:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75200 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224413.940850:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006462816d/0xcfd8b3ae4b165abb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.940868:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006462816d/0xcfd8b3ae4b165abb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.940880:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006462816d/0xcfd8b3ae4b165abb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.941105:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006462816d/0xcfd8b3ae4b165abb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.941123:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.941124:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.941126:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224413.941534:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.941546:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011f66b8/0xcfd8b3ae4b165ac2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.941555:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.941558:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.941563:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000011f66b8/0xcfd8b3ae4b165ac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.941572:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000011f66b8/0xcfd8b3ae4b165ac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.941581:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011f66b8/0xcfd8b3ae4b165ac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.941588:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000011f66b8/0xcfd8b3ae4b165ac2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.941601:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224413.941608:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224413.941612:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000011f66b8/0xcfd8b3ae4b165ac2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.941619:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75a00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224413.941622:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000011f66b8/0xcfd8b3ae4b165ac2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.941630:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000011f66b8/0xcfd8b3ae4b165ac2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.941646:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000011f66b8/0xcfd8b3ae4b165ac2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.941653:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000011f66b8/0xcfd8b3ae4b165ac2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.941665:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.941667:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.941668:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224413.942041:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.942047:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165ac9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.942056:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.942058:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.942062:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165ac9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.942071:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165ac9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.942079:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165ac9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.942087:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165ac9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.942108:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224413.942116:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224413.942119:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165ac9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.942126:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea88a75000 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224413.942129:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165ac9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.942139:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165ac9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.942149:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165ac9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.942156:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b12c7856/0xcfd8b3ae4b165ac9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.942168:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.942170:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.942172:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224413.948329:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.948353:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b95259/0xcfd8b3ae4b165ad0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.948370:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.948381:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.948387:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b95259/0xcfd8b3ae4b165ad0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.948402:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b95259/0xcfd8b3ae4b165ad0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.948413:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b95259/0xcfd8b3ae4b165ad0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.948422:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b95259/0xcfd8b3ae4b165ad0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.948438:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224413.948450:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224413.948455:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b95259/0xcfd8b3ae4b165ad0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.948463:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86c00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224413.948467:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b95259/0xcfd8b3ae4b165ad0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.948476:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b95259/0xcfd8b3ae4b165ad0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.948491:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b95259/0xcfd8b3ae4b165ad0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.948509:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b95259/0xcfd8b3ae4b165ad0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.948529:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.948530:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.948532:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224413.949004:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.949010:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000526fa045/0xcfd8b3ae4b165ad7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949038:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.949042:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.949046:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000526fa045/0xcfd8b3ae4b165ad7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949056:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000526fa045/0xcfd8b3ae4b165ad7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949064:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000526fa045/0xcfd8b3ae4b165ad7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949072:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000526fa045/0xcfd8b3ae4b165ad7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949084:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224413.949092:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224413.949102:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000526fa045/0xcfd8b3ae4b165ad7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949110:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224413.949113:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000526fa045/0xcfd8b3ae4b165ad7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949122:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000526fa045/0xcfd8b3ae4b165ad7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949132:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000526fa045/0xcfd8b3ae4b165ad7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949139:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000526fa045/0xcfd8b3ae4b165ad7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949153:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.949155:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.949156:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224413.949535:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.949541:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733c33c4/0xcfd8b3ae4b165ade lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949550:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.949553:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.949558:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733c33c4/0xcfd8b3ae4b165ade lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949577:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733c33c4/0xcfd8b3ae4b165ade lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949586:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733c33c4/0xcfd8b3ae4b165ade lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949593:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733c33c4/0xcfd8b3ae4b165ade lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949605:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224413.949612:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224413.949616:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733c33c4/0xcfd8b3ae4b165ade lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949622:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87c00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224413.949626:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733c33c4/0xcfd8b3ae4b165ade lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949634:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733c33c4/0xcfd8b3ae4b165ade lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949643:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733c33c4/0xcfd8b3ae4b165ade lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949651:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733c33c4/0xcfd8b3ae4b165ade lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.949669:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.949671:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.949673:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224413.950043:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.950049:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4969eeb/0xcfd8b3ae4b165ae5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950057:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.950060:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.950065:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4969eeb/0xcfd8b3ae4b165ae5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950073:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4969eeb/0xcfd8b3ae4b165ae5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950082:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4969eeb/0xcfd8b3ae4b165ae5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950102:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4969eeb/0xcfd8b3ae4b165ae5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950115:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224413.950122:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224413.950125:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4969eeb/0xcfd8b3ae4b165ae5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950143:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87000 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224413.950146:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4969eeb/0xcfd8b3ae4b165ae5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950153:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4969eeb/0xcfd8b3ae4b165ae5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950164:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4969eeb/0xcfd8b3ae4b165ae5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950172:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4969eeb/0xcfd8b3ae4b165ae5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950184:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.950186:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.950188:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224413.950551:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.950557:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165aec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950566:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.950568:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.950573:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165aec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950582:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165aec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950594:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165aec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950602:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165aec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950613:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224413.950620:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224413.950623:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165aec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950629:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87a00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224413.950633:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165aec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950641:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165aec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950651:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165aec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950658:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165aec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.950670:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.950676:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.950678:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224413.951003:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.951008:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165af3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.951035:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.951038:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.951043:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165af3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.951052:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165af3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.951061:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165af3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.951068:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165af3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.951080:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224413.951086:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224413.951088:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165af3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.951096:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87800 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224413.951100:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165af3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.951117:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165af3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.951128:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165af3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.951135:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165af3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.951146:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.951148:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.951149:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224413.978823:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.978837:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092a5c254/0xcfd8b3ae4b165afa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.978862:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.978867:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.978873:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092a5c254/0xcfd8b3ae4b165afa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.978888:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092a5c254/0xcfd8b3ae4b165afa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.978902:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092a5c254/0xcfd8b3ae4b165afa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.978926:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092a5c254/0xcfd8b3ae4b165afa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.978945:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224413.978958:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224413.978963:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092a5c254/0xcfd8b3ae4b165afa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.978970:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86a00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224413.978975:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092a5c254/0xcfd8b3ae4b165afa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.978984:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092a5c254/0xcfd8b3ae4b165afa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.979001:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092a5c254/0xcfd8b3ae4b165afa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.979008:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092a5c254/0xcfd8b3ae4b165afa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.979038:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.979040:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.979042:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224413.979734:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.979746:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165b01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.979766:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.979770:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.979775:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165b01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.979784:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165b01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.979793:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165b01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.979800:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165b01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.979814:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224413.979823:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224413.979827:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165b01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.979833:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87600 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224413.979837:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165b01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.979846:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165b01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.979862:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165b01 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.979870:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165b01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.979882:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.979883:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.979885:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224413.981507:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.981516:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002735b81b/0xcfd8b3ae4b165b08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.981527:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.981531:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.981536:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002735b81b/0xcfd8b3ae4b165b08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.981546:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002735b81b/0xcfd8b3ae4b165b08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.981555:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002735b81b/0xcfd8b3ae4b165b08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.981562:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002735b81b/0xcfd8b3ae4b165b08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.981590:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224413.981602:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224413.981606:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002735b81b/0xcfd8b3ae4b165b08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.981614:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224413.981618:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002735b81b/0xcfd8b3ae4b165b08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.981627:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002735b81b/0xcfd8b3ae4b165b08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.981639:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002735b81b/0xcfd8b3ae4b165b08 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.981646:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002735b81b/0xcfd8b3ae4b165b08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.981660:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.981662:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.981663:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224413.982508:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.982515:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001798adc4/0xcfd8b3ae4b165b0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.982524:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.982532:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.982537:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001798adc4/0xcfd8b3ae4b165b0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.982546:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001798adc4/0xcfd8b3ae4b165b0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.982554:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001798adc4/0xcfd8b3ae4b165b0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.982562:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001798adc4/0xcfd8b3ae4b165b0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.982575:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224413.982584:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224413.982588:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001798adc4/0xcfd8b3ae4b165b0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.982594:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86e00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224413.982598:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001798adc4/0xcfd8b3ae4b165b0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.982606:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001798adc4/0xcfd8b3ae4b165b0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.982616:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001798adc4/0xcfd8b3ae4b165b0f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.982634:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001798adc4/0xcfd8b3ae4b165b0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.982646:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.982648:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.982649:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224413.986852:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.986874:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7334dc6/0xcfd8b3ae4b165b16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.986891:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.986895:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.986901:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7334dc6/0xcfd8b3ae4b165b16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.987754:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7334dc6/0xcfd8b3ae4b165b16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.987777:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7334dc6/0xcfd8b3ae4b165b16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.987785:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7334dc6/0xcfd8b3ae4b165b16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.987807:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224413.987823:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224413.987836:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7334dc6/0xcfd8b3ae4b165b16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.987844:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86600 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224413.987848:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7334dc6/0xcfd8b3ae4b165b16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.987867:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7334dc6/0xcfd8b3ae4b165b16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.987884:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7334dc6/0xcfd8b3ae4b165b16 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.987892:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7334dc6/0xcfd8b3ae4b165b16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.988047:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.988049:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.988051:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224413.988536:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.988543:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.988552:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.988555:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.988560:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.988580:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.988590:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.988596:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.988610:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224413.988618:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224413.988623:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.988630:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86800 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224413.988633:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.988641:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.988652:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b1d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.988660:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.988689:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.988691:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.988693:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224413.994652:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224413.998309:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.998335:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224413.998351:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224413.998358:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.998376:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.998388:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.998397:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.998414:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224413.998428:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224413.998433:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.998453:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86000 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224413.998457:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.998467:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.998483:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b24 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.998490:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224413.998511:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.998512:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224413.998514:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224414.008663:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224414.008687:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.008703:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224414.008708:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224414.008713:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.008727:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.008744:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.008751:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.009333:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224414.009360:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224414.009366:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.009376:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87800 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224414.009381:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.009391:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.009407:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b2b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.009415:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.009433:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224414.009439:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224414.009441:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224414.011486:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224414.011497:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.011511:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224414.011515:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224414.011520:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.011532:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.011542:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.011549:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.011564:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224414.011575:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224414.011580:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.011588:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87a00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224414.011592:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.011612:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.011625:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b32 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.011633:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.011648:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224414.011649:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224414.011651:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224414.017652:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224414.018805:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.018828:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224414.018832:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224414.018839:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.018855:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.018866:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.018891:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.019062:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782224414.019079:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224414.019215:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.019226:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86000 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224414.019231:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.019241:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.019258:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.019267:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.019286:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224414.019287:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224414.019289:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782224414.023045:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1782224414.026613:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224414.026634:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.026651:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224414.026656:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224414.026662:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.027875:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.027888:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.027897:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.028844:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782224414.029862:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224414.029871:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.029882:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86800 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224414.029887:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.029898:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.030500:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b40 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.030510:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056a882d8/0xcfd8b3ae4b165b40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.030536:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224414.030538:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224414.030540:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224414.033564:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224414.033582:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.033598:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224414.033603:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224414.033609:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.033623:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.033639:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.033647:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.033672:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782224414.034119:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224414.034124:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.034133:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224414.034135:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224414.034139:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.034148:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.034155:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.034163:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.034198:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782224414.034741:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782224414.034749:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.034759:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87a00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224414.034764:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.034774:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.034791:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b47 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.034799:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019193e57/0xcfd8b3ae4b165b47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.034815:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224414.034818:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.034824:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87800 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224414.034834:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.034843:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.034852:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b4e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.034859:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165b4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.034870:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224414.034872:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224414.034873:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224414.039469:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782224414.042292:0:14854:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782224414.042306:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.042324:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1782224414.042329:0:14854:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224414.042336:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.042367:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.042377:0:14854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.042385:0:14854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224414.042406:0:14854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1782224414.042622:0:14854:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:1.0:1782224414.042974:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224414.042982:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.042992:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86000 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224414.042997:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.043007:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.043050:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b55 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.043066:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028574639/0xcfd8b3ae4b165b55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224414.043083:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224414.043085:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224414.043086:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224414.046328:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14242:x1868797333046656:12345-0@lo:5:osp-pre-0-0.0 Request processed in 177650us (177775us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224414.046353:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782224414.046414:0:14242:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14242:1868797333046656:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1782224414.046444:0:14242:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1782224414.046490:0:14242:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14242:1868797333046784:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1782224414.046528:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224414.046569:0:14242:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90caca80 going to sleep for 11 seconds 00000100:00100000:0.0:1782224414.046593:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333046784 00000100:00100000:0.0:1782224414.046597:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333046784 00000100:00100000:0.0:1782224414.046633:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782224414.046640:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14242:x1868797333046784:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1782224414.050287:0:14856:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1782224414.096183:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14242:x1868797333046784:12345-0@lo:5:osp-pre-0-0.0 Request processed in 49536us (49648us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1782224414.096198:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782224414.105836:0:14242:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14242:1868797333046784:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1782224414.105864:0:14242:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1782224414.357505:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224415.389751:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782224415.636062:0:15523:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782224415.636066:0:15523:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1782224415.636171:0:15523:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff96eabfcb1000 00000020:01000004:2.0:1782224415.636188:0:15523:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1782224415.636202:0:15523:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1782224415.636220:0:15523:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff96eabf19cd40) 00000020:00000080:2.0:1782224415.636252:0:15523:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1782224415.678622:0:15523:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1782224415.678935:0:15523:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1782224415.680435:0:15523:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1782224415.680693:0:15523:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1782224415.680919:0:15523:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1782224415.683764:0:15523:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 499: rc = 0 00100000:10000000:2.0:1782224415.683930:0:15523:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 499: rc = 0 00100000:10000000:2.0:1782224415.684383:0:15523:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 499: rc = 0 00100000:10000000:2.0:1782224415.693121:0:15523:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1782224415.701832:0:15523:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1782224415.702492:0:15523:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1782224415.703004:0:15523:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:3.0:1782224415.704983:0:15523:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:3.0:1782224415.705905:0:15523:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00000020:00000080:3.0:1782224415.707962:0:15523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1782224415.707979:0:15523:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782224415.707994:0:15523:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcfd8b3ae4b165b63 00000020:01000004:3.0:1782224415.708005:0:15523:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1782224415.708148:0:15523:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.107@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782224415.708152:0:15523:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.107@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782224415.708160:0:15523:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1782224415.708192:0:15523:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1782224415.708198:0:15523:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.107@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1782224415.750954:0:15523:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.107@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782224415.751537:0:15523:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.107@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1782224415.751545:0:15523:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782224415.751547:0:15523:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782224415.751548:0:15523:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782224415.751549:0:15523:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782224415.751551:0:15523:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782224415.751553:0:15523:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782224415.751554:0:15523:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782224415.751557:0:15523:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782224415.751558:0:15523:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782224415.751563:0:15523:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1782224415.751566:0:15523:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782224415.751567:0:15523:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782224415.751568:0:15523:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782224415.751569:0:15523:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782224415.751570:0:15523:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782224415.751572:0:15523:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782224415.751573:0:15523:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782224415.751574:0:15523:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782224415.751584:0:15523:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782224415.751621:0:15523:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1782224415.751659:0:15523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333046912:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1782224415.751755:0:15523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224415.751885:0:15523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90cac3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224415.752518:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333046912 00000100:00100000:2.0:1782224415.752529:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333046912 00000100:00100000:2.0:1782224415.752612:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782224415.752624:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:15523:x1868797333046912:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782224415.752746:0:14212:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1782224415.752750:0:14212:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1782224415.752769:0:14212:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1782224415.778510:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:15523:x1868797333046912:12345-0@lo:253:mount.lustre.0 Request processed in 25874us (26741us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224415.778529:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782224415.778878:0:15523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333046912:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782224415.778900:0:15523:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782224415.778903:0:15523:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782224415.778905:0:15523:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782224415.778907:0:15523:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782224415.778908:0:15523:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782224415.778909:0:15523:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782224415.778911:0:15523:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782224415.778913:0:15523:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782224415.778915:0:15523:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782224415.778917:0:15523:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782224415.778948:0:15523:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96eabfcb1000 from lustre-OST0001 10000000:01000000:2.0:1782224415.778981:0:15523:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1782224415.778984:0:15523:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1782224415.778995:0:15523:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96ea83ec8000 local copy 00010000:00010000:2.0:1782224415.779009:0:15523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b165909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165910 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224415.779582:0:15523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83279180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333047040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782224415.779640:0:15523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224415.779823:0:15523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabf7f2540 going to sleep for 11 seconds 00000100:00100000:0.0:1782224415.789974:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333047040 00000100:00100000:0.0:1782224415.789995:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333047040 00000100:00100000:2.0:1782224415.794123:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782224415.794142:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:15523:x1868797333047040:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782224415.795536:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:15523:x1868797333047040:12345-0@lo:501:mount.lustre.0 Request processed in 1393us (15888us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782224415.795552:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782224415.795825:0:15523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83279180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333047040:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1782224415.795867:0:15523:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.107@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782224415.796097:0:15523:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.107@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782224415.796109:0:15523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b165909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165910 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224415.796123:0:15523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea90675e00/0xcfd8b3ae4b165909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165910 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782224415.796157:0:15523:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96eabfcb1000 10000000:01000000:3.0:1782224415.796163:0:15523:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782224415.796170:0:15523:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782224415.796173:0:15523:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782224415.796179:0:15523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1782224415.796182:0:15523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782224415.796224:0:15523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b165b6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224415.796247:0:15523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b165b6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224415.796257:0:15523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b165b6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224415.796283:0:15523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333047168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782224415.796350:0:15523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224415.800996:0:15523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabc887cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224415.801650:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333047168 00000100:00100000:0.0:1782224415.801734:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333047168 00000100:00100000:2.0:1782224415.801877:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782224415.801894:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:15523:x1868797333047168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782224415.801917:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224415.801960:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbbaba00/0xcfd8b3ae4b165b71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b165b6a expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224415.801998:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbbaba00/0xcfd8b3ae4b165b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165b6a expref: 17 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224415.802029:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbbaba00/0xcfd8b3ae4b165b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165b6a expref: 17 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224415.802040:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaba00, rc 0) 00000100:00100000:2.0:1782224415.802136:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+17:15523:x1868797333047168:12345-0@lo:101:mount.lustre.0 Request processed in 246us (5785us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224415.802143:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782224415.802494:0:15523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333047168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782224415.802514:0:15523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b165b6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165b71 expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224415.802525:0:15523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b165b6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b165b71 expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782224415.803833:0:15523:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1782224415.806536:0:15523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782224415.808011:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1782224415.808194:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1782224415.808334:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1782224415.808390:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1782224415.808424:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1782224415.808458:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1782224415.808540:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1782224415.808548:0:15523:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1782224415.808968:0:15523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333047296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782224415.809158:0:15523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224415.809213:0:15523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabf7f2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782224415.809602:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333047296 00000100:00100000:3.0:1782224415.809612:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333047296 00000100:00100000:3.0:1782224415.810670:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782224415.810686:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+17:15523:x1868797333047296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782224415.811627:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+17:15523:x1868797333047296:12345-0@lo:501:mount.lustre.0 Request processed in 942us (2466us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224415.811638:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782224415.811822:0:15523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333047296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782224415.811897:0:15523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333047424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782224415.811951:0:15523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224415.812003:0:15523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90cac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782224415.812211:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333047424 00000100:00100000:1.0:1782224415.812219:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333047424 00000100:00100000:1.0:1782224415.812258:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782224415.812267:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+17:15523:x1868797333047424:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782224415.812625:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+17:15523:x1868797333047424:12345-0@lo:503:mount.lustre.0 Request processed in 358us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224415.812632:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782224415.812911:0:15523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333047424:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782224415.815545:0:15523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782224415.815747:0:15523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333047552:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782224415.815910:0:15523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224415.816123:0:15523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90cac3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782224415.816275:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333047552 00000100:00100000:2.0:1782224415.816285:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333047552 00000100:00100000:1.0:1782224415.816438:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782224415.816453:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+17:15523:x1868797333047552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782224415.816896:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+17:15523:x1868797333047552:12345-0@lo:502:mount.lustre.0 Request processed in 446us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224415.816905:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782224415.817358:0:15523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333047552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782224415.817733:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1782224415.817795:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1782224415.817831:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1782224415.818048:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1782224415.818168:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1782224415.818210:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1782224415.818274:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1782224415.818311:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1782224415.818373:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1782224415.818421:0:15523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333047680:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782224415.818495:0:15523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224415.819001:0:15523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90cac3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782224415.819255:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333047680 00000100:00100000:3.0:1782224415.819265:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333047680 00000100:00100000:3.0:1782224415.819316:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782224415.819337:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+17:15523:x1868797333047680:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782224415.819924:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+17:15523:x1868797333047680:12345-0@lo:502:mount.lustre.0 Request processed in 596us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224415.819935:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782224415.820164:0:15523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333047680:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782224415.820300:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1782224415.820315:0:15523:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1782224415.821975:0:15524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782224415.821988:0:15524:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1782224415.821996:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782224415.821999:0:15524:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1782224415.822007:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782224415.822186:0:15524:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff96ea90cb3380) 00000020:00000080:2.0:1782224415.822216:0:15524:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1782224415.822223:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782224415.822383:0:15524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96eabfcb1000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1782224415.822393:0:15524:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782224415.822401:0:15524:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcfd8b3ae4b165b7f 00010000:00010000:2.0:1782224415.827832:0:15524:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1782224415.828595:0:15524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1782224415.864858:0:15524:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1782224415.922207:0:15524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1782224415.922225:0:15524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782224415.922235:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224415.922238:0:15524:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1782224415.922244:0:15524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782224415.922265:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224415.922266:0:15524:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782224415.922271:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782224415.922273:0:15524:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782224415.922275:0:15524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782224415.922278:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224415.922280:0:15524:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782224415.922282:0:15524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782224415.922285:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224415.922286:0:15524:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782224415.922290:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1782224415.922386:0:15524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782224415.922390:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782224415.922391:0:15524:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782224415.922395:0:15524:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1782224415.925151:0:15523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1782224415.925202:0:15523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1782224415.925227:0:15523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b165b6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165b71 expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224415.925243:0:15523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96ea90675600/0xcfd8b3ae4b165b6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165b71 expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782224415.925251:0:15523:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96eabfcb1000 from 1 10000000:01000000:0.0:1782224415.925255:0:15523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782224415.925303:0:15523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb87600/0xcfd8b3ae4b165b86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224415.925312:0:15523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabbb87600/0xcfd8b3ae4b165b86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224415.925338:0:15523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabbb87600/0xcfd8b3ae4b165b86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224415.925370:0:15523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333047808:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782224415.925472:0:15523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224415.925536:0:15523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90caca80 going to sleep for 11 seconds 00000100:00100000:3.0:1782224415.926503:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333047808 00000100:00100000:3.0:1782224415.926525:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333047808 00000100:00100000:3.0:1782224415.926591:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782224415.926603:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+17:15523:x1868797333047808:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782224415.926623:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224415.926642:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea90674c00/0xcfd8b3ae4b165b8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b165b86 expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224415.926673:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90674c00/0xcfd8b3ae4b165b8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165b86 expref: 18 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224415.926686:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea90674c00/0xcfd8b3ae4b165b8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165b86 expref: 18 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224415.926697:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674c00, rc 0) 00000100:00100000:3.0:1782224415.926767:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+18:15523:x1868797333047808:12345-0@lo:101:mount.lustre.0 Request processed in 167us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224415.926775:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782224415.933351:0:15523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333047808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782224415.933388:0:15523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabbb87600/0xcfd8b3ae4b165b86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165b8d expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224415.933404:0:15523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabbb87600/0xcfd8b3ae4b165b86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b165b8d expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782224415.934367:0:15523:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1782224415.935359:0:15523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782224415.935638:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1782224415.935689:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1782224415.935762:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1782224415.935781:0:15523:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1782224415.935889:0:15523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333047936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782224415.935976:0:15523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224415.936076:0:15523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa7a0f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224415.937012:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333047936 00000100:00100000:0.0:1782224415.937046:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333047936 00000100:00100000:0.0:1782224415.937112:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782224415.937126:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+18:15523:x1868797333047936:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782224415.937457:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+18:15523:x1868797333047936:12345-0@lo:501:mount.lustre.0 Request processed in 333us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224415.937467:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782224415.937526:0:15523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333047936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782224415.937585:0:15523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333048064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782224415.937640:0:15523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224415.937672:0:15523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90cac840 going to sleep for 11 seconds 00000100:00100000:0.0:1782224415.937691:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333048064 00000100:00100000:0.0:1782224415.937695:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333048064 00000100:00100000:0.0:1782224415.937716:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782224415.937723:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+18:15523:x1868797333048064:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782224415.937892:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+18:15523:x1868797333048064:12345-0@lo:503:mount.lustre.0 Request processed in 168us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224415.937899:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782224415.937943:0:15523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333048064:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782224415.938663:0:15523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782224415.938749:0:15523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333048192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782224415.938807:0:15523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224415.938834:0:15523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90cac840 going to sleep for 11 seconds 00000100:00100000:0.0:1782224415.938869:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333048192 00000100:00100000:0.0:1782224415.938875:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333048192 00000100:00100000:0.0:1782224415.938900:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782224415.938908:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+18:15523:x1868797333048192:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782224415.939106:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+18:15523:x1868797333048192:12345-0@lo:502:mount.lustre.0 Request processed in 197us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224415.939114:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782224415.939163:0:15523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333048192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782224415.939411:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1782224415.939462:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1782224415.939514:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1782224415.939553:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1782224415.939591:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1782224415.939643:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1782224415.939680:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1782224415.939714:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1782224415.939744:0:15523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333048320:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782224415.939788:0:15523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224415.939811:0:15523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90cac840 going to sleep for 11 seconds 00000100:00100000:0.0:1782224415.939831:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333048320 00000100:00100000:0.0:1782224415.939836:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333048320 00000100:00100000:0.0:1782224415.939861:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782224415.939869:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+18:15523:x1868797333048320:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782224415.940006:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+18:15523:x1868797333048320:12345-0@lo:502:mount.lustre.0 Request processed in 137us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224415.940038:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782224415.940084:0:15523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333048320:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782224415.940170:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1782224415.940179:0:15523:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1782224415.959402:0:15529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782224415.959423:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224415.959425:0:15529:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782224415.959433:0:15529:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96eabfcb1000 00000020:00000080:0.0:1782224415.959435:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782224415.959444:0:15529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782224415.959447:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224415.959449:0:15529:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1782224415.959451:0:15529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782224415.959454:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224415.959455:0:15529:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782224415.959459:0:15529:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96eabfcb1000 00000020:00000080:0.0:1782224415.959461:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782224415.959535:0:15529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782224415.959539:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224415.959540:0:15529:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1782224415.959543:0:15529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782224415.959546:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224415.959547:0:15529:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782224415.959551:0:15529:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96eabfcb1000 00000020:00000080:0.0:1782224415.959553:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782224415.959592:0:15529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782224415.959595:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782224415.959597:0:15529:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1782224415.959601:0:15529:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1782224415.962266:0:15523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1782224415.962316:0:15523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782224415.962346:0:15523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbb87600/0xcfd8b3ae4b165b86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165b8d expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224415.962361:0:15523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabbb87600/0xcfd8b3ae4b165b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165b8d expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224415.962427:0:15523:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782224415.962430:0:15523:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96eabfcb1000 10000000:01000000:2.0:1782224415.962434:0:15523:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96eabfcb1000 10000000:01000000:2.0:1782224415.962438:0:15523:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782224415.962444:0:15523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff96eabfcb1000 from 1 10000000:01000000:2.0:1782224415.962447:0:15523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782224415.962492:0:15523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbbab800/0xcfd8b3ae4b165b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224415.962502:0:15523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabbbab800/0xcfd8b3ae4b165b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224415.962515:0:15523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabbbab800/0xcfd8b3ae4b165b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224415.962547:0:15523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333048448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782224415.962664:0:15523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224415.962714:0:15523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88076a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782224415.964470:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333048448 00000100:00100000:0.0:1782224415.964489:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333048448 00000100:00100000:0.0:1782224415.964559:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782224415.964573:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+18:15523:x1868797333048448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782224415.964600:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224415.964636:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbb86a00/0xcfd8b3ae4b165b9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b165b94 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224415.966808:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbb86a00/0xcfd8b3ae4b165b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165b94 expref: 19 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224415.966831:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbb86a00/0xcfd8b3ae4b165b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165b94 expref: 19 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224415.966853:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbb86a00, rc 0) 00000100:00100000:0.0:1782224415.966968:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:15523:x1868797333048448:12345-0@lo:101:mount.lustre.0 Request processed in 2397us (4302us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224415.966977:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782224415.967080:0:15523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333048448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782224415.967104:0:15523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabbbab800/0xcfd8b3ae4b165b94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165b9b expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224415.967113:0:15523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabbbab800/0xcfd8b3ae4b165b94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b165b9b expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782224415.967888:0:15523:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1782224415.968561:0:15523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782224415.968882:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1782224415.968925:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1782224415.968952:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1782224415.968990:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1782224415.969067:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1782224415.969120:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1782224415.969158:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1782224415.969189:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1782224415.969250:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1782224415.969289:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1782224415.979192:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1782224415.979415:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1782224415.979458:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1782224415.979496:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1782224415.979548:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1782224415.979586:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1782224415.979620:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1782224415.980369:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1782224415.980433:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1782224415.980467:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1782224415.980515:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1782224415.980555:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1782224415.980592:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1782224415.985815:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1782224415.989547:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1782224415.989600:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1782224415.992118:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1782224415.992246:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1782224415.992286:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1782224415.995541:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1782224415.995699:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1782224415.995740:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1782224415.995786:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1782224416.004678:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1782224416.004852:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1782224416.004937:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1782224416.004977:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1782224416.005120:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1782224416.005129:0:15523:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1782224416.005290:0:15523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333048576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782224416.005403:0:15523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224416.005460:0:15523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea86357540 going to sleep for 11 seconds 00000100:00100000:3.0:1782224416.007703:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333048576 00000100:00100000:3.0:1782224416.007720:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333048576 00000100:00100000:3.0:1782224416.007789:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782224416.007803:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:15523:x1868797333048576:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782224416.008261:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:15523:x1868797333048576:12345-0@lo:501:mount.lustre.0 Request processed in 459us (2856us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224416.008272:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782224416.020379:0:15523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333048576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782224416.029064:0:15523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333048704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782224416.029168:0:15523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224416.029221:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333048704 00000100:00100000:0.0:1782224416.029230:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333048704 00000100:00100000:0.0:1782224416.029296:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782224416.029306:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:15523:x1868797333048704:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782224416.029532:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:15523:x1868797333048704:12345-0@lo:503:mount.lustre.0 Request processed in 226us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224416.029540:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782224416.029674:0:15523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea863576c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782224416.029700:0:15523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333048704:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782224416.030403:0:15523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782224416.030502:0:15523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333048832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782224416.030900:0:15523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224416.030943:0:15523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea863576c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782224416.031519:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333048832 00000100:00100000:1.0:1782224416.031530:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333048832 00000100:00100000:1.0:1782224416.031592:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782224416.031604:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:15523:x1868797333048832:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782224416.032212:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:15523:x1868797333048832:12345-0@lo:502:mount.lustre.0 Request processed in 608us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224416.032222:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782224416.035300:0:15523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333048832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782224416.037978:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1782224416.038161:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1782224416.038221:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1782224416.042735:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1782224416.042795:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1782224416.042858:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1782224416.042897:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1782224416.042944:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1782224416.042995:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1782224416.043060:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1782224416.043095:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1782224416.043143:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1782224416.043179:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1782224416.043213:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1782224416.043280:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1782224416.045506:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1782224416.045610:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1782224416.045782:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1782224416.045826:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1782224416.045990:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1782224416.046092:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1782224416.046132:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1782224416.046169:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1782224416.046221:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1782224416.048390:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1782224416.049627:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1782224416.051085:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1782224416.051182:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1782224416.053388:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1782224416.053539:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1782224416.053581:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1782224416.053619:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1782224416.055809:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1782224416.057183:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1782224416.057257:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1782224416.057311:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1782224416.057385:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1782224416.057422:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1782224416.057471:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1782224416.057507:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1782224416.057573:0:15523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c25500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333048960:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782224416.057696:0:15523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224416.057761:0:15523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaa7a0f840 going to sleep for 11 seconds 00000100:00100000:0.0:1782224416.058301:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333048960 00000100:00100000:0.0:1782224416.058311:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333048960 00000100:00100000:0.0:1782224416.058369:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782224416.058378:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:15523:x1868797333048960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782224416.058667:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:15523:x1868797333048960:12345-0@lo:502:mount.lustre.0 Request processed in 288us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224416.058676:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782224416.064573:0:15523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c25500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333048960:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782224416.065499:0:15523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1782224416.065530:0:15523:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1782224416.086205:0:15534:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1782224416.086331:0:15534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff96ea83efcd40) 00000020:00000080:1.0:1782224416.086370:0:15534:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1782224416.086936:0:15534:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96eabfcb1000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782224416.086942:0:15534:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96eabfcb1000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782224416.086946:0:15534:0:(obd_mount.c:701:lustre_put_lsi()) put ffff96eabfcb1000 3 00010000:00080000:1.0:1782224416.087007:0:15534:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96eaa7f72800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.107@tcp at head 00010000:00010000:1.0:1782224416.099466:0:15534:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1782224416.099604:0:15534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1782224416.099660:0:15534:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782224416.099675:0:15534:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcfd8b3ae4b165ba9 00000100:00080000:1.0:1782224416.099688:0:15534:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782224416.099694:0:15534:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96eaa7f72800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:1.0:1782224416.099740:0:15534:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96eabf796300 x1868797333049088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782224416.099794:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1868797333049088:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782224416.099890:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224416.099973:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333049088 00000100:00100000:1.0:1782224416.099983:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333049088 00000100:00100000:1.0:1782224416.100058:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782224416.100067:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1868797333049088:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1782224416.100094:0:14219:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:1.0:1782224416.100130:0:14219:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcfd8b3ae4b165bb0 00000004:00100000:1.0:1782224416.100150:0:14219:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782224416.100188:0:14219:0:(import.c:65:import_set_state_nolock()) ffff96ea916d1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782224416.100247:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1868797333049088:12345-0@lo:38:llog_process_th.0 Request processed in 179us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224416.100256:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1782224416.100301:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eabf796300 x1868797333049088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782224426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224416.100312:0:3302:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782224416.100332:0:3302:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1782224416.100349:0:3302:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1782224416.100354:0:3302:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782224416.100357:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96eaa7f72800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782224416.100366:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1868797333049088:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1782224416.100387:0:15534:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782224416.100441:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782224416.100446:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782224416.100448:0:36:0:(import.c:65:import_set_state_nolock()) ffff96ea9834f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782224416.100452:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 494 00000100:00080000:1.0:1782224416.100456:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1782224416.100461:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96ea9834f800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:1.0:1782224416.100475:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96eabf794a80 x1868797333049344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782224416.100525:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333049216:0@lo:400:kworker.0 00000100:00100000:1.0:1782224416.100556:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224416.100578:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782224416.100583:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333049472:0@lo:400:kworker.0 00000100:00100000:1.0:1782224416.100603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224416.100629:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333049344:0@lo:8:kworker.0 00000100:00100000:1.0:1782224416.100649:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224416.100675:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333049600:0@lo:400:kworker.0 00000100:00100000:1.0:1782224416.100701:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224416.100733:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333049216 00000100:00100000:1.0:1782224416.100737:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333049216 00000100:00100000:1.0:1782224416.100773:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333049344 00000100:00100000:1.0:1782224416.100782:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333049344 00000100:00100000:1.0:1782224416.100796:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782224416.100802:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1868797333049216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224416.100838:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1868797333049216:12345-0@lo:400:kworker.0 Request processed in 37us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224416.100844:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782224416.100854:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224416.100857:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3302:x1868797333049344:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1782224416.100887:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3302:x1868797333049344:12345-0@lo:8:kworker.0 Request processed in 28us (237us total) trans 0 rc -11/-11 00000100:00100000:1.0:1782224416.100892:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224416.100908:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333049472 00000100:00100000:1.0:1782224416.100911:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333049472 00000100:00100000:1.0:1782224416.100930:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333049600 00000100:00100000:1.0:1782224416.100933:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333049600 00000100:00100000:1.0:1782224416.100951:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782224416.100956:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333049472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224416.100982:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333049472:12345-0@lo:400:kworker.0 Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224416.100988:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782224416.100997:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782224416.101002:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333049600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224416.101054:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333049600:12345-0@lo:400:kworker.0 Request processed in 52us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224416.101060:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1782224416.101077:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782224416.101082:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782224416.101113:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eabf796680 x1868797333049472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224416.101125:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333049472:0@lo:400:kworker.0 00000100:00100000:1.0:1782224416.101136:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333049216:0@lo:400:kworker.0 00000100:00100000:1.0:1782224416.101161:0:3302:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782224416.101165:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96ea9834f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782224416.101170:0:3302:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1782224416.101172:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333049344:0@lo:8:kworker.0 00010000:00080000:1.0:1782224416.101195:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96eabf797480 x1868797333049600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224416.101204:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333049600:0@lo:400:kworker.0 00000040:00080000:1.0:1782224416.107799:0:15534:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1782224416.107954:0:15523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1782224416.107987:0:15523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782224416.108006:0:15523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbbab800/0xcfd8b3ae4b165b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165b9b expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224416.108038:0:15523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabbbab800/0xcfd8b3ae4b165b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165b9b expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782224416.108402:0:15523:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782224416.108405:0:15523:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782224416.108407:0:15523:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782224416.108408:0:15523:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782224416.108410:0:15523:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782224416.108412:0:15523:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782224416.108414:0:15523:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782224416.108416:0:15523:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782224416.108422:0:15523:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782224416.108427:0:15523:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1782224416.108430:0:15523:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782224416.108431:0:15523:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782224416.108432:0:15523:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782224416.108433:0:15523:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782224416.108435:0:15523:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782224416.108436:0:15523:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782224416.108437:0:15523:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782224416.108438:0:15523:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782224416.108439:0:15523:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782224416.108470:0:15523:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1782224416.108495:0:15523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf797480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333049728:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1782224416.108591:0:15523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224416.108635:0:15523:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea882c8840 going to sleep for 11 seconds 00000100:00100000:1.0:1782224416.108667:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333049728 00000100:00100000:1.0:1782224416.108675:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333049728 00000100:00100000:1.0:1782224416.108739:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782224416.108750:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:15523:x1868797333049728:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782224416.108804:0:14214:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1782224416.108822:0:14214:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00080000:3.0:1782224416.181075:0:6608:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1782224416.181143:0:6608:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 20000000:01000000:1.0:1782224416.273738:0:14214:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782224416.273756:0:14214:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1782224416.274093:0:14235:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1782224416.274099:0:14235:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1782224416.274125:0:14235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96ea90675000/0xcfd8b3ae4b165bb7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224416.274148:0:14235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b165a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165a83 expref: 19 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224416.274157:0:14235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96ea90675000/0xcfd8b3ae4b165bb7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224416.274207:0:14235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b165a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b165a83 expref: 19 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224416.274223:0:14235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b165a8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b165a83 expref: 19 pid: 14213 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224416.274240:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c26d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14235:1868797333049856:0@lo:104: 00000100:00100000:3.0:1782224416.274343:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224416.274404:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8352c600 going to sleep for 11 seconds 00000100:00100000:2.0:1782224416.275739:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333049856 00000100:00100000:2.0:1782224416.275754:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333049856 00000100:00100000:2.0:1782224416.275838:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782224416.275852:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+3:14235:x1868797333049856:12345-0@lo:104: 00010000:00010000:2.0:1782224416.278090:0:14203:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55600/0xcfd8b3ae4b165a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b165a8a expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224416.278246:0:14203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782224416.278256:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+3:14235:x1868797333049856:12345-0@lo:104: Request processed in 2404us (3911us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224416.278267:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1782224416.278459:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782224416.278467:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55600/0xcfd8b3ae4b165a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b165a8a expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224416.278475:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55600 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:2.0:1782224416.278479:0:14208:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55600/0xcfd8b3ae4b165a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b165a8a expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224416.278490:0:14208:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55600/0xcfd8b3ae4b165a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b165a8a expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782224416.278497:0:14208:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55600/0xcfd8b3ae4b165a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b165a8a expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224416.278503:0:14208:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782224416.278555:0:14208:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55600/0xcfd8b3ae4b165a83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b165a8a expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224416.278586:0:14208:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782224416.278614:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55600/0xcfd8b3ae4b165a83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b165a8a expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224416.278621:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55600/0xcfd8b3ae4b165a83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b165a8a expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224416.278643:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224416.278645:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224416.278647:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224416.278675:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3304:1868797333049984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782224416.278728:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224416.278794:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333049984 00000100:00100000:2.0:1782224416.278803:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333049984 00000100:00100000:3.0:1782224416.279239:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c26d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14235:1868797333049856:0@lo:104: 00010000:00010000:3.0:1782224416.279270:0:14235:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96ea90675000/0xcfd8b3ae4b165bb7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224416.282538:0:14206:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b165a8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b165a83 expref: 20 pid: 14213 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224416.282843:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782224416.282869:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83278000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+20:3304:x1868797333049984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782224416.282894:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224416.282902:0:14206:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b165a8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b165a83 expref: 20 pid: 14213 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224416.282915:0:14206:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b165a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b165a83 expref: 20 pid: 14213 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224416.282936:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90675200/0xcfd8b3ae4b165a8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b165a83 expref: 20 pid: 14213 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224416.282959:0:14206:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96ea90675000/0xcfd8b3ae4b165bb7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224416.282968:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90675000/0xcfd8b3ae4b165bb7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782224416.282987:0:14206:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016940255s 00010000:00010000:3.0:1782224416.282993:0:14206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea90675000/0xcfd8b3ae4b165bb7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224416.283000:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea90675000/0xcfd8b3ae4b165bb7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224416.283008:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96ea90675000/0xcfd8b3ae4b165bb7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224416.283066:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96ea90675000/0xcfd8b3ae4b165bb7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224416.283074:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675000 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224416.283079:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96ea90675000/0xcfd8b3ae4b165bb7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224416.283090:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96ea90675000/0xcfd8b3ae4b165bb7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224416.283107:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96ea90675000/0xcfd8b3ae4b165bb7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224416.283122:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224416.283214:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83278000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:3304:x1868797333049984:12345-0@lo:103:ldlm_bl.0 Request processed in 360us (4486us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224416.283223:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1782224416.283264:0:14235:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96ea90675000/0xcfd8b3ae4b165bb7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224416.283273:0:14235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96ea90675000/0xcfd8b3ae4b165bb7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224416.283281:0:14235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90675000/0xcfd8b3ae4b165bb7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224416.283457:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3304:1868797333049984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782224416.312075:0:15523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf797480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:15523:1868797333049728:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782224416.312102:0:15523:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782224416.312107:0:15523:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782224416.312109:0:15523:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782224416.312110:0:15523:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782224416.312112:0:15523:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782224416.312113:0:15523:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782224416.312115:0:15523:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782224416.312117:0:15523:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782224416.312119:0:15523:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782224416.312121:0:15523:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782224416.312144:0:15523:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1782224416.313062:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+18:15523:x1868797333049728:12345-0@lo:253:mount.lustre.0 Request processed in 203086us (203243us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224416.313084:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00080000:10000000:3.0:1782224416.336556:0:15523:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1782224416.336756:0:15523:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1782224416.336968:0:15523:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1782224416.337175:0:15523:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1782224416.337313:0:15523:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1782224416.337562:0:15523:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1782224416.342440:0:15523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1782224416.421465:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1782224416.596111:0:15523:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1782224416.596125:0:15523:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1782224416.596171:0:15523:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782224416.596262:0:15523:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.107@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782224416.596283:0:15523:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1782224416.596334:0:15523:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1782224417.443419:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782224417.758272:0:14216:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782224417.758364:0:14216:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff96ea8512c800 from 8 10000000:01000000:2.0:1782224417.758372:0:14216:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782224417.758437:0:14216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbbab000/0xcfd8b3ae4b165bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224417.758451:0:14216:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabbbab000/0xcfd8b3ae4b165bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224417.758464:0:14216:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabbbab000/0xcfd8b3ae4b165bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224417.759815:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333050112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782224417.760273:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224417.760703:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333050112 00000100:00100000:3.0:1782224417.760716:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88076840 going to sleep for 11 seconds 00000100:00100000:0.0:1782224417.760716:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333050112 00000100:00100000:2.0:1782224417.761254:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782224417.761274:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+18:14216:x1868797333050112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782224417.762165:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224417.762200:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbbab400/0xcfd8b3ae4b165bc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b165bbe expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224417.762241:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbbab400/0xcfd8b3ae4b165bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165bbe expref: 19 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224417.762255:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbbab400/0xcfd8b3ae4b165bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165bbe expref: 19 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224417.763408:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab400, rc 0) 00000100:00100000:2.0:1782224417.763968:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:14216:x1868797333050112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2698us (3691us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224417.763979:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782224417.765245:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333050112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782224417.765280:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabbbab000/0xcfd8b3ae4b165bbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165bc5 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224417.766420:0:14216:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabbbab000/0xcfd8b3ae4b165bbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b165bc5 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224417.767364:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea8327bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333050240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1782224417.767463:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224417.769429:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88076780 going to sleep for 11 seconds 00000100:00100000:1.0:1782224417.769533:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333050240 00000100:00100000:1.0:1782224417.769546:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333050240 00000100:00100000:1.0:1782224417.769728:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782224417.769742:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:14216:x1868797333050240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1782224417.769775:0:14214:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782224417.769799:0:14214:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782224417.769802:0:14214:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1782224417.769963:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:14216:x1868797333050240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 223us (2499us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224417.769972:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782224417.769989:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea8327bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333050240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782224417.770111:0:14216:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782224417.770124:0:14216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbbab000/0xcfd8b3ae4b165bbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165bc5 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224417.770135:0:14216:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabbbab000/0xcfd8b3ae4b165bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165bc5 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224418.453315:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224418.903041:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782224418.903091:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333050368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782224418.903192:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224418.903285:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333050368 00000100:00100000:3.0:1782224418.903305:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333050368 00000100:00100000:3.0:1782224418.903377:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782224418.903388:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333050368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782224418.903437:0:14858:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224418.903501:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333050368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224418.903509:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1782224418.903534:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782224418.903565:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1782224418.903602:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333050368:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782224419.477841:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224420.500173:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782224420.887108:0:14253:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1782224421.462432:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1782224421.463372:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782224421.463403:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3305:1868797333050496:0@lo:400:kworker.0 00000100:00080000:3.0:1782224421.463681:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1782224421.463687:0:36:0:(import.c:65:import_set_state_nolock()) ffff96ea9834f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782224421.463699:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96ea9834f800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:3.0:1782224421.463734:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96e987c25500 x1868797333050752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782224421.466892:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224421.466992:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797333051008:0@lo:400:kworker.0 00000100:00100000:2.0:1782224421.467069:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224421.467228:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333051008 00000100:00100000:1.0:1782224421.467238:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333051008 00000100:00100000:1.0:1782224421.467323:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782224421.467336:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8327bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797333051008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224421.467399:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8327bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797333051008:12345-0@lo:400:kworker.0 Request processed in 67us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224421.467406:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782224421.467693:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333051136:0@lo:400:kworker.0 00000100:00100000:3.0:1782224421.467737:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224421.467961:0:3302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333050752:0@lo:8:kworker.0 00000100:00100000:1.0:1782224421.468000:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224421.468105:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333050624:0@lo:400:kworker.0 00000100:00100000:2.0:1782224421.468148:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224421.468171:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224421.468178:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797333050880:0@lo:400:kworker.0 00000100:00100000:2.0:1782224421.468201:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1782224421.475445:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e987c24380 x1868797333051008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224421.475470:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797333051008:0@lo:400:kworker.0 00000100:00080000:1.0:1782224421.485061:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224421.485097:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333051136 00000100:00100000:1.0:1782224421.485122:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333051136 00000100:00100000:1.0:1782224421.485222:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333050880 00000100:00100000:1.0:1782224421.485226:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333050880 00000100:00100000:1.0:1782224421.485250:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782224421.485261:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797333051136:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782224421.485395:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224421.485424:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797333051136:12345-0@lo:400:kworker.0 Request processed in 164us (17685us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224421.485432:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782224421.485463:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782224421.485471:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8327a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797333050880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224421.485505:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8327a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797333050880:12345-0@lo:400:kworker.0 Request processed in 35us (17303us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224421.485511:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782224421.485540:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333050752 00000100:00100000:1.0:1782224421.485544:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333050752 00000100:00100000:1.0:1782224421.485568:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333050624 00000100:00100000:1.0:1782224421.485572:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333050624 00000100:00100000:3.0:1782224421.485601:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782224421.485610:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8327b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333050624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224421.485650:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8327b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333050624:12345-0@lo:400:kworker.0 Request processed in 42us (17502us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224421.485656:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782224421.485671:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782224421.485675:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1868797333050752:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1782224421.485704:0:14854:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:3.0:1782224421.485745:0:14854:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcfd8b3ae4b165bcc 00002000:00100000:3.0:1782224421.485763:0:14854:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff96e98758a800 ocd_connect_flags: 0xe044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1782224421.485767:0:14854:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1782224421.485771:0:14854:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:1.0:1782224421.485847:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e987c26a00 x1868797333051136/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224421.485864:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333051136:0@lo:400:kworker.0 00000100:00080000:1.0:1782224421.485892:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1782224421.486392:0:14854:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782224421.486435:0:14854:0:(import.c:65:import_set_state_nolock()) ffff96e98758e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782224421.486489:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1868797333050752:12345-0@lo:8:kworker.0 Request processed in 811us (18488us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224421.486496:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1782224421.486528:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e987c25500 x1868797333050752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782224446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782224421.486543:0:3302:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1782224421.486552:0:3302:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xe040401443000026 00000100:00080000:1.0:1782224421.486559:0:3302:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1782224421.486562:0:3302:0:(import.c:65:import_set_state_nolock()) ffff96ea9834f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1782224421.486592:0:3302:0:(osp_dev.c:1650:osp_import_event()) got connected 00000100:00100000:1.0:1782224421.486660:0:3302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1868797333050752:0@lo:8:kworker.0 00000004:00080000:3.0:1782224421.488451:0:14244:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1782224421.488500:0:14244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c27100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14244:1868797333051392:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1782224421.488580:0:14244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224421.488621:0:14244:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea851d19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782224421.488642:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782224421.488653:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333051264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782224421.488678:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224421.488709:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333051264 00000100:00100000:3.0:1782224421.488716:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333051264 00000100:00100000:3.0:1782224421.488779:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782224421.489227:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1868797333051264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782224421.489557:0:14858:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224421.489627:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1868797333051264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 404us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224421.489635:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782224421.489683:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e987c24380 x1868797333051264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782224437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782224421.489702:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333051264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782224421.490418:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333051392 00000100:00100000:1.0:1782224421.490427:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333051392 00000100:00100000:1.0:1782224421.490551:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782224421.490559:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14244:x1868797333051392:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1782224421.491526:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333050496 00000100:00100000:2.0:1782224421.491536:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333050496 00000100:00100000:2.0:1782224421.491585:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782224421.491604:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:3305:x1868797333050496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224421.491697:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:3305:x1868797333050496:12345-0@lo:400:kworker.0 Request processed in 104us (24813us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224421.491715:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782224421.491747:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3305:1868797333050496:0@lo:400:kworker.0 00010000:00080000:2.0:1782224421.492048:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96e987c25c00 x1868797333050880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782224421.492062:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797333050880:0@lo:400:kworker.0 00000100:00100000:2.0:1782224421.492078:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333050624:0@lo:400:kworker.0 00000004:00080000:0.0:1782224421.493203:0:14243:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782224421.493757:0:14243:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 502273740499ns, next at 0ns, rc = 0 00000100:00080000:0.0:1782224421.512880:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1782224421.513130:0:14855:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1782224421.513144:0:14855:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1782224421.513153:0:14855:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00010000:00010000:2.0:1782224421.536287:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782224421.549227:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.549246:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165bd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.549278:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.549283:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.549291:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.549312:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.549325:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.549333:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165bd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.549358:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782224421.550003:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.550010:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165bda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550062:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.550065:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.550070:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165bda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550080:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165bda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550089:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165bda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550097:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165bda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550120:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782224421.550137:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782224421.550144:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165bd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550152:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54000 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224421.550157:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165bd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550166:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165bd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550196:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165bd3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550204:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165bd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550223:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224421.550227:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165bda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550233:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55c00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224421.550237:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165bda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550245:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165bda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550256:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165bda lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550264:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165bda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550286:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224421.550288:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224421.550296:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782224421.550701:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.550708:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165be1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550717:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.550720:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.550724:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165be1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550733:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165be1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550740:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165be1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550746:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165be1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550760:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782224421.550768:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224421.550771:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165be1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550776:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224421.550779:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165be1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550799:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165be1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550810:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165be1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550817:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165be1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.550829:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224421.550831:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224421.550832:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782224421.551318:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.551326:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165be8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.551335:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.551339:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.551343:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165be8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.551354:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165be8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.551362:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165be8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.551378:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165be8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.551392:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782224421.551401:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224421.551405:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165be8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.551413:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54c00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224421.551417:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165be8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.551426:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165be8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.551438:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165be8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.551446:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165be8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.551459:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224421.551461:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224421.551463:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782224421.551880:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.551895:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.551905:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.551908:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.551912:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.551922:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.551930:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.551936:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.551950:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782224421.551958:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224421.551962:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.551969:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224421.551973:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.551981:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.551999:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.552007:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.552050:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224421.552052:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224421.552053:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224421.560831:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782224421.591974:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.591993:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.592037:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.592044:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.592052:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.592070:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.592083:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.592092:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.592927:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782224421.592944:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224421.592951:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.592960:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224421.592965:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.592974:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.592995:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bf6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.593003:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165bf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.593043:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224421.593045:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224421.593047:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782224421.595541:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.595555:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165bfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.595573:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.595590:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.595663:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165bfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.595682:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165bfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.595693:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165bfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.595701:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165bfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.595773:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782224421.596972:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.596981:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.596995:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.596998:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.597003:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.599449:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.599481:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.599511:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.602813:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782224421.602832:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165bfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.602848:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54c00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:2.0:1782224421.602853:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165bfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.602865:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165bfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.602898:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165bfd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.602906:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165bfd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.602931:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782224421.602935:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.602957:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:2.0:1782224421.602960:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.602968:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.602977:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c04 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.602984:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224421.602986:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224421.602988:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782224421.607122:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1782224421.608981:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782224421.609000:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.609925:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782224421.610472:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.610484:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.610503:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.610509:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.610516:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.610534:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.610546:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.610553:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.610585:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782224421.611702:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224421.611714:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.611726:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55c00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224421.611731:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.611741:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.611764:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c0b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.611771:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.611855:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224421.611857:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224421.611859:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782224421.613411:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.613424:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165c12 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.613442:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.613456:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.613462:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165c12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.613478:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165c12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.613488:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165c12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.613496:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165c12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.613517:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782224421.613976:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.613982:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.613992:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.613995:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.613999:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.614009:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.614045:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.614059:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.614088:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1782224421.614509:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.614515:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.614524:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.614527:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.614531:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.614541:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.614549:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.614557:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.614565:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1782224421.614940:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.614946:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.614961:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.614964:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.614969:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.614978:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.614986:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.614993:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.615001:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1782224421.615439:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.615445:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.615454:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.615458:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.615462:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.615472:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.615492:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.615500:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.615509:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1782224421.615899:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.615905:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.615914:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.615918:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.615922:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.615931:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.615941:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.615949:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.615973:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1782224421.616653:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1782224421.616662:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165c12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616672:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54000 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224421.616677:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165c12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616695:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165c12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616718:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165c12 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616725:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e55004ce/0xcfd8b3ae4b165c12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616747:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1782224421.616751:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616757:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54200 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224421.616760:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616767:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616777:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616793:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616819:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782224421.616823:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616831:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55200 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224421.616834:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616843:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616853:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c20 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616861:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616873:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782224421.616877:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616884:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55a00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224421.616887:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616906:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616916:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c27 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616924:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616937:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782224421.616940:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616946:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54600 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224421.616948:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616956:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616965:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c2e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616973:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.616996:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782224421.616999:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.617006:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55600 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224421.617009:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.617050:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.617062:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.617070:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.617083:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224421.617085:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224421.617087:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224421.618586:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782224421.652505:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.652528:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.652551:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.652557:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.652564:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.652582:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.652595:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.652604:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.652624:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782224421.653928:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782224421.653940:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.653952:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224421.653965:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.653977:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.654000:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c3c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.654007:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165c3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.654049:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224421.654051:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224421.654054:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782224421.657574:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.657589:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165c43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.657612:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.657622:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.657630:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165c43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.657648:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165c43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.657659:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165c43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.657668:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165c43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.657699:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782224421.658148:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.658154:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000242318a/0xcfd8b3ae4b165c4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.658162:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.658164:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.658169:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000242318a/0xcfd8b3ae4b165c4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.658178:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000242318a/0xcfd8b3ae4b165c4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.658186:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000242318a/0xcfd8b3ae4b165c4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.658198:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000242318a/0xcfd8b3ae4b165c4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.658211:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1782224421.658559:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.658565:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165c51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.658573:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.658576:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.658580:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165c51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.658589:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165c51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.658597:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165c51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.658604:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165c51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.658611:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1782224421.658975:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.658980:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165c58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.658992:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.658995:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.658999:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165c58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.659007:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165c58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.659036:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165c58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.659044:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165c58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.659051:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1782224421.663333:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782224421.663354:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165c43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663374:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224421.663380:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165c43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663392:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165c43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663419:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165c43 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663446:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165c43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663471:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782224421.663475:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000242318a/0xcfd8b3ae4b165c4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663482:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55800 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224421.663485:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000242318a/0xcfd8b3ae4b165c4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663492:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000242318a/0xcfd8b3ae4b165c4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663502:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000242318a/0xcfd8b3ae4b165c4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663509:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000242318a/0xcfd8b3ae4b165c4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663521:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782224421.663525:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165c51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663531:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54800 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224421.663542:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165c51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663550:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165c51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663560:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165c51 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663569:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165c51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663581:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782224421.663585:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165c58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663590:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54c00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224421.663594:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165c58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663600:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165c58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663608:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165c58 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663615:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c02aad30/0xcfd8b3ae4b165c58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.663634:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224421.663636:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224421.663638:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224421.663664:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782224421.667373:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.667391:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.667412:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.667418:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.667425:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.667441:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.667469:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.667477:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.667499:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782224421.668435:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782224421.668447:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.668458:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55c00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224421.668464:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.668475:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.668497:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c5f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.668505:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165c5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.668525:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224421.668527:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224421.668529:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782224421.672074:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.672283:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.672306:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.672311:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.672318:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.672339:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.672351:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.672360:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.672398:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782224421.677781:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.680830:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.680855:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.680861:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.680869:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.680889:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.680904:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.680913:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.680963:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782224421.682650:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782224421.682664:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.682699:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55600 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224421.682704:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.682716:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.682740:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c66 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.682748:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003c510bc/0xcfd8b3ae4b165c66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.682780:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782224421.682796:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.682803:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54600 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224421.682807:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.682814:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.682825:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c6d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.682841:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165c6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.682857:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224421.682859:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224421.682861:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224421.682869:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782224421.694601:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.694617:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.694637:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.694650:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.694658:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.694678:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.694691:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.694700:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.694725:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782224421.697994:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.698010:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.698059:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.698063:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.698069:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.698086:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.698597:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782224421.698607:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.698617:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55a00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224421.698623:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.698634:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.698655:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c74 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.698662:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000962d6bc0/0xcfd8b3ae4b165c74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.698683:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224421.698685:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224421.698696:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224421.700393:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.700413:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.700439:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782224421.700575:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782224421.700582:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.700592:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55200 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224421.700596:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.700606:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.700623:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.700631:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f79b6aec/0xcfd8b3ae4b165c7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224421.700650:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224421.700652:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224421.700653:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782224421.708865:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782224421.708888:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.708909:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1782224421.708914:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224421.708921:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.708938:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.708950:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.708958:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224421.708991:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782224421.709138:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782224421.709147:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.709156:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54200 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:2.0:1782224421.709161:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.709172:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.709213:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.709222:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009031406f/0xcfd8b3ae4b165c82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.709263:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224421.709265:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224421.709277:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782224421.715624:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782224421.715643:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000551c5146/0xcfd8b3ae4b165c89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.715664:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1782224421.715669:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782224421.715676:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000551c5146/0xcfd8b3ae4b165c89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.715692:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000551c5146/0xcfd8b3ae4b165c89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.715704:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000551c5146/0xcfd8b3ae4b165c89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.715713:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000551c5146/0xcfd8b3ae4b165c89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224421.715757:0:14855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1782224421.716072:0:14855:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1782224421.716201:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14244:x1868797333051392:12345-0@lo:5:osp-pre-1-0.0 Request processed in 225637us (227615us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224421.716218:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1782224421.724281:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782224421.724300:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000551c5146/0xcfd8b3ae4b165c89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224421.724319:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaa400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224421.724324:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000551c5146/0xcfd8b3ae4b165c89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224421.724337:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000551c5146/0xcfd8b3ae4b165c89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224421.724373:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000551c5146/0xcfd8b3ae4b165c89 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224421.724381:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000551c5146/0xcfd8b3ae4b165c89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224421.724430:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224421.724432:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224421.724434:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224421.725120:0:14244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c27100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14244:1868797333051392:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1782224421.725143:0:14244:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1782224421.725249:0:14244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf796300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14244:1868797333051520:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1782224421.725361:0:14244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224421.725427:0:14244:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea882c8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782224421.725453:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333051520 00000100:00100000:1.0:1782224421.725461:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333051520 00000100:00100000:1.0:1782224421.725541:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782224421.725551:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14244:x1868797333051520:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1782224421.725612:0:14854:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1782224421.763835:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14244:x1868797333051520:12345-0@lo:5:osp-pre-1-0.0 Request processed in 38260us (38450us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1782224421.763853:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782224421.766863:0:14244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf796300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14244:1868797333051520:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1782224421.766892:0:14244:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1782224422.551836:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224423.573529:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224424.022357:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224424.022389:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333051648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782224424.022493:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224424.022733:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333051648 00000100:00100000:0.0:1782224424.022745:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333051648 00000100:00100000:0.0:1782224424.022835:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782224424.022847:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea8327a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333051648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782224424.022898:0:14858:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782224424.022980:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea8327a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333051648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224424.023342:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782224424.023405:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333051648:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782224424.024786:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782224424.607152:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224425.626178:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224426.581373:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3305:1868797333051776:0@lo:400:kworker.0 00000100:00100000:0.0:1782224426.581478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224426.581539:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797333052288:0@lo:400:kworker.0 00000100:00100000:0.0:1782224426.581566:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224426.581595:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782224426.581600:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333051904:0@lo:400:kworker.0 00000100:00100000:0.0:1782224426.581625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224426.581644:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797333052416:0@lo:400:kworker.0 00000100:00100000:0.0:1782224426.581672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224426.581695:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333052032:0@lo:400:kworker.0 00000100:00100000:0.0:1782224426.581726:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224426.581743:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782224426.581748:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797333052160:0@lo:400:kworker.0 00000100:00100000:0.0:1782224426.581768:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224426.581816:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333051904 00000100:00100000:0.0:1782224426.581825:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333051904 00000100:00100000:0.0:1782224426.581881:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333052032 00000100:00100000:0.0:1782224426.581884:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333052032 00000100:00100000:0.0:1782224426.581902:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782224426.581911:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333051904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224426.581972:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333051904:12345-0@lo:400:kworker.0 Request processed in 61us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224426.581980:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782224426.582003:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782224426.582008:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1868797333052032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224426.582066:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1868797333052032:12345-0@lo:400:kworker.0 Request processed in 58us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224426.582072:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782224426.582432:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333052032:0@lo:400:kworker.0 00000100:00100000:0.0:1782224426.582470:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333051904:0@lo:400:kworker.0 00000100:00100000:1.0:1782224426.583355:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782224426.583371:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333052544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782224426.583428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224426.583477:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333052288 00000100:00100000:1.0:1782224426.583483:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333052288 00000100:00100000:1.0:1782224426.583532:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333052416 00000100:00100000:1.0:1782224426.583535:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333052416 00000100:00100000:1.0:1782224426.583550:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333052160 00000100:00100000:1.0:1782224426.583552:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333052160 00000100:00100000:1.0:1782224426.583566:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782224426.583573:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797333052288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224426.583623:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797333052288:12345-0@lo:400:kworker.0 Request processed in 49us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224426.583630:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782224426.583645:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782224426.583650:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797333052416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224426.583683:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868797333052416:12345-0@lo:400:kworker.0 Request processed in 33us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224426.583689:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782224426.583698:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782224426.583704:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797333052160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224426.583724:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797333052160:12345-0@lo:400:kworker.0 Request processed in 21us (1956us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224426.583730:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782224426.583757:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333052544 00000100:00100000:1.0:1782224426.583760:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333052544 00000100:00100000:1.0:1782224426.583782:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224426.583788:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1868797333052544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782224426.583818:0:14858:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224426.583848:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1868797333052544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224426.583854:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224426.583889:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333052544:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1782224426.583921:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eaa7a08380 x1868797333052416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224426.583933:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1868797333052416:0@lo:400:kworker.0 00010000:00080000:1.0:1782224426.583945:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eaa7a0ad80 x1868797333052288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782224426.583954:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797333052288:0@lo:400:kworker.0 00010000:00080000:0.0:1782224426.584098:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96eaa7a09c00 x1868797333052160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782224442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782224426.584109:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797333052160:0@lo:400:kworker.0 00000100:00100000:2.0:1782224426.584181:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333051776 00000100:00100000:2.0:1782224426.584186:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333051776 00000100:00100000:2.0:1782224426.584232:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782224426.584240:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:3305:x1868797333051776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224426.584284:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:3305:x1868797333051776:12345-0@lo:400:kworker.0 Request processed in 46us (2807us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224426.584290:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1782224426.584328:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782224426.584335:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782224426.584337:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782224426.585296:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3305:1868797333051776:0@lo:400:kworker.0 00000001:00080000:3.0:1782224426.629935:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1782224426.630007:0:7486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1782224426.645234:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782224427.624235:0:15879:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782224427.670479:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224428.695258:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224429.141958:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782224429.141992:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333052672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782224429.142102:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224429.142188:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333052672 00000100:00100000:1.0:1782224429.142208:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333052672 00000100:00100000:1.0:1782224429.142283:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782224429.142294:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333052672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782224429.142342:0:14858:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224429.142402:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333052672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224429.142411:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1782224429.142439:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782224429.142488:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333052672:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782224429.716157:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224429.905686:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224429.906172:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312082176 00000100:00100000:0.0:1782224429.906182:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312082176 00000100:00100000:0.0:1782224429.906244:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 76 00000100:00100000:0.0:1782224429.906252:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2345:x1868797312082176:12345-192.168.202.7@tcp:250:mount.lustre.0 00010000:00080000:0.0:1782224429.906284:0:14214:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 619c3a44-0550-47ff-a7c5-bf61e2d0dfbb@192.168.202.7@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1782224429.906320:0:14214:0:(genops.c:1406:class_connect()) connect: client 619c3a44-0550-47ff-a7c5-bf61e2d0dfbb, cookie 0xcfd8b3ae4b165c90 00000100:00080000:0.0:1782224429.908054:0:14214:0:(import.c:65:import_set_state_nolock()) ffff96e987988000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782224429.908207:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+5:2345:x1868797312082176:12345-192.168.202.7@tcp:250:mount.lustre.0 Request processed in 1953us (2534us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224429.908218:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 76 00000100:00100000:2.0:1782224429.923577:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224429.923676:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312082304 00000100:00100000:1.0:1782224429.923689:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312082304 00000100:00100000:1.0:1782224429.923752:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 77 00000100:00100000:1.0:1782224429.923763:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+5:13707:x1868797312082304:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782224429.923793:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224429.923814:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eaa7d55800/0xcfd8b3ae4b165c97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51935 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224429.923846:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eaa7d55800/0xcfd8b3ae4b165c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51935 expref: 6 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224429.923858:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eaa7d55800/0xcfd8b3ae4b165c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51935 expref: 6 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224429.923890:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d55800, rc 0) 00000100:00100000:1.0:1782224429.923968:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+6:13707:x1868797312082304:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 207us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224429.923977:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 77 00000100:00100000:2.0:1782224429.929329:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224429.929483:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312082432 00000100:00100000:0.0:1782224429.929495:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312082432 00000100:00100000:0.0:1782224429.929553:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 78 00000100:00100000:0.0:1782224429.929563:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+6:13707:x1868797312082432:12345-192.168.202.7@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782224429.929954:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+6:13707:x1868797312082432:12345-192.168.202.7@tcp:501:mount.lustre.0 Request processed in 391us (634us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782224429.929964:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 78 00000100:00100000:0.0:1782224429.943854:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224429.944444:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312082560 00000100:00100000:2.0:1782224429.944456:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312082560 00000100:00100000:2.0:1782224429.944517:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 79 00000100:00100000:2.0:1782224429.944528:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+6:13707:x1868797312082560:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782224429.944548:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224429.944566:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbbab600/0xcfd8b3ae4b165c9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5193c expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224429.944596:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbbab600/0xcfd8b3ae4b165c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5193c expref: 7 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224429.944607:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbbab600/0xcfd8b3ae4b165c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5193c expref: 7 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224429.944617:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbab600, rc 0) 00000100:00100000:2.0:1782224429.945471:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+7:13707:x1868797312082560:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 938us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224429.945482:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 79 00000100:00100000:0.0:1782224429.952582:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224429.952678:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312082688 00000100:00100000:1.0:1782224429.952689:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312082688 00000100:00100000:1.0:1782224429.952751:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 80 00000100:00100000:1.0:1782224429.952762:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+7:13707:x1868797312082688:12345-192.168.202.7@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782224429.953102:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+8:13707:x1868797312082688:12345-192.168.202.7@tcp:501:mount.lustre.0 Request processed in 341us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224429.953110:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 80 00000100:00100000:0.0:1782224429.959858:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224429.959980:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312082816 00000100:00100000:2.0:1782224429.959990:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312082816 00000100:00100000:2.0:1782224429.960072:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 81 00000100:00100000:2.0:1782224429.960084:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabe851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+8:13707:x1868797312082816:12345-192.168.202.7@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782224429.960400:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabe851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+8:13707:x1868797312082816:12345-192.168.202.7@tcp:503:mount.lustre.0 Request processed in 318us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224429.960414:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 81 00000100:00100000:1.0:1782224429.962655:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224429.963138:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312082944 00000100:00100000:0.0:1782224429.963150:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312082944 00000100:00100000:0.0:1782224429.963221:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 82 00000100:00100000:0.0:1782224429.963232:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+8:13726:x1868797312082944:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782224429.963626:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+8:13726:x1868797312082944:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 393us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224429.963634:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 82 00000100:00100000:0.0:1782224429.983430:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224429.983549:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312083072 00000100:00100000:1.0:1782224429.983560:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312083072 00000100:00100000:1.0:1782224429.983620:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 83 00000100:00100000:1.0:1782224429.983630:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+8:13726:x1868797312083072:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782224429.983961:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+8:13726:x1868797312083072:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 331us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224429.983969:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 83 00000100:00100000:1.0:1782224429.993519:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224429.993631:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312083200 00000100:00100000:2.0:1782224429.993642:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312083200 00000100:00100000:2.0:1782224429.993702:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 84 00000100:00100000:2.0:1782224429.993719:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+8:13707:x1868797312083200:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782224429.993740:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224429.993758:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbbaaa00/0xcfd8b3ae4b165ca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51966 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224429.993800:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbbaaa00/0xcfd8b3ae4b165ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51966 expref: 9 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224429.993812:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbbaaa00/0xcfd8b3ae4b165ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51966 expref: 9 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224429.993822:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaaa00, rc 0) 00000100:00100000:2.0:1782224429.993900:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+9:13707:x1868797312083200:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 183us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224429.993910:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 84 00000100:00100000:2.0:1782224430.001619:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224430.001940:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312083328 00000100:00100000:0.0:1782224430.001951:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312083328 00000100:00100000:0.0:1782224430.002005:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 85 00000100:00100000:0.0:1782224430.002053:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+9:13707:x1868797312083328:12345-192.168.202.7@tcp:256:mount.lustre.0 20000000:01000000:0.0:1782224430.002079:0:14214:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782224430.002099:0:14214:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782224430.002103:0:14214:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782224430.002106:0:14214:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782224430.002108:0:14214:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1782224430.009749:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+9:13707:x1868797312083328:12345-192.168.202.7@tcp:256:mount.lustre.0 Request processed in 7724us (8130us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224430.009765:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 85 00000100:00100000:1.0:1782224430.017630:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224430.017999:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312083456 00000100:00100000:2.0:1782224430.018010:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312083456 00000100:00100000:2.0:1782224430.018122:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 86 00000100:00100000:2.0:1782224430.018133:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+9:13707:x1868797312083456:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782224430.018152:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224430.018171:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbbabe00/0xcfd8b3ae4b165cac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5196d expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224430.018226:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbbabe00/0xcfd8b3ae4b165cac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5196d expref: 10 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224430.018455:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbbabe00/0xcfd8b3ae4b165cac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5196d expref: 10 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224430.018469:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbabe00, rc 0) 00000100:00100000:2.0:1782224430.018549:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+10:13707:x1868797312083456:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 418us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224430.018557:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 86 00000100:00100000:2.0:1782224430.027280:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224430.027916:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312083584 00000100:00100000:1.0:1782224430.027928:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312083584 00000100:00100000:1.0:1782224430.027985:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 87 00000100:00100000:1.0:1782224430.027996:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+10:13707:x1868797312083584:12345-192.168.202.7@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782224430.028556:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+10:13707:x1868797312083584:12345-192.168.202.7@tcp:501:mount.lustre.0 Request processed in 560us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224430.028566:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 87 00000100:00100000:0.0:1782224430.050632:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224430.050746:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312083712 00000100:00100000:2.0:1782224430.050756:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312083712 00000100:00100000:2.0:1782224430.050822:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 88 00000100:00100000:2.0:1782224430.050832:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+10:13707:x1868797312083712:12345-192.168.202.7@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782224430.051288:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+10:13707:x1868797312083712:12345-192.168.202.7@tcp:503:mount.lustre.0 Request processed in 455us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224430.051298:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 88 00000100:00100000:0.0:1782224430.062410:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224430.062518:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312083840 00000100:00100000:1.0:1782224430.062529:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312083840 00000100:00100000:1.0:1782224430.062590:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 89 00000100:00100000:1.0:1782224430.062603:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+10:13731:x1868797312083840:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782224430.062947:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+10:13731:x1868797312083840:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 345us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224430.062957:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 89 00000100:00100000:1.0:1782224430.088868:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224430.089929:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312083968 00000100:00100000:0.0:1782224430.089955:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312083968 00000100:00100000:0.0:1782224430.090056:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 90 00000100:00100000:0.0:1782224430.090068:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+10:13731:x1868797312083968:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782224430.090361:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+10:13731:x1868797312083968:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 295us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224430.090369:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 90 00000040:00080000:2.0:1782224430.105653:0:14253:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782224430.119426:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224430.119647:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312084096 00000100:00100000:1.0:1782224430.119658:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312084096 00000100:00100000:1.0:1782224430.119718:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:1.0:1782224430.119727:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2345:x1868797312084096:12345-192.168.202.7@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782224430.119761:0:14879:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 243224f9-f297-4a07-ab60-b6a19179afcf@192.168.202.7@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:1.0:1782224430.119834:0:14879:0:(genops.c:1406:class_connect()) connect: client 243224f9-f297-4a07-ab60-b6a19179afcf, cookie 0xcfd8b3ae4b165cb3 00000004:00100000:1.0:1782224430.119882:0:14879:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:1.0:1782224430.119889:0:14879:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1782224430.222108:0:14879:0:(import.c:65:import_set_state_nolock()) ffff96ea916d7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782224430.222232:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+6:2345:x1868797312084096:12345-192.168.202.7@tcp:38:mount.lustre.0 Request processed in 102503us (102815us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224430.222269:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:2.0:1782224430.237697:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224430.238195:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312084352 00000100:00100000:1.0:1782224430.238212:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312084352 00000100:00100000:1.0:1782224430.238322:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:1.0:1782224430.238336:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+6:13707:x1868797312084352:12345-192.168.202.7@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782224430.238403:0:14220:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782224430.238518:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+6:13707:x1868797312084352:12345-192.168.202.7@tcp:41:mount.lustre.0 Request processed in 185us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224430.238527:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00080000:2.0:1782224430.238880:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782224430.241315:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224430.241455:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312084224 00000100:00100000:1.0:1782224430.241469:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312084224 00000100:00100000:1.0:1782224430.241561:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:1.0:1782224430.241577:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:243224f9-f297-4a07-ab60-b6a19179afcf+6:0:x1868797312084224:12345-192.168.202.7@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782224430.241638:0:14219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782224430.241892:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:243224f9-f297-4a07-ab60-b6a19179afcf+6:0:x1868797312084224:12345-192.168.202.7@tcp:41:mount.lustre.0 Request processed in 319us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224430.241903:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:1.0:1782224430.262865:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224430.263318:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312084480 00000100:00100000:2.0:1782224430.263334:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312084480 00000100:00100000:2.0:1782224430.263407:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:2.0:1782224430.263420:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+6:13707:x1868797312084480:12345-192.168.202.7@tcp:40:mount.lustre.0 00000100:00100000:2.0:1782224430.263570:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+6:13707:x1868797312084480:12345-192.168.202.7@tcp:40:mount.lustre.0 Request processed in 151us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224430.263579:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:1.0:1782224430.275879:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224430.275934:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224430.275978:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224430.276172:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312084608 00000100:00100000:0.0:1782224430.276197:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312084608 00000100:00100000:0.0:1782224430.276252:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312084736 00000100:00100000:0.0:1782224430.276255:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312084736 00000100:00100000:0.0:1782224430.276272:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:0.0:1782224430.276283:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1868797312084608:12345-192.168.202.7@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782224430.276323:0:14856:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 243224f9-f297-4a07-ab60-b6a19179afcf@192.168.202.7@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:0.0:1782224430.276375:0:14856:0:(genops.c:1406:class_connect()) connect: client 243224f9-f297-4a07-ab60-b6a19179afcf, cookie 0xcfd8b3ae4b165cba 00002000:00100000:0.0:1782224430.276395:0:14856:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 243224f9-f297-4a07-ab60-b6a19179afcf/ffff96e98798f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782224430.276435:0:14856:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1782224430.276927:0:14856:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782224430.276974:0:14856:0:(import.c:65:import_set_state_nolock()) ffff96e98798c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782224430.277104:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:243224f9-f297-4a07-ab60-b6a19179afcf+6:2345:x1868797312084608:12345-192.168.202.7@tcp:8:mount.lustre.0 Request processed in 820us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224430.277113:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:0.0:1782224430.277141:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:0.0:1782224430.277146:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1868797312084736:12345-192.168.202.7@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782224430.277163:0:14856:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 243224f9-f297-4a07-ab60-b6a19179afcf@192.168.202.7@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:0.0:1782224430.277215:0:14856:0:(genops.c:1406:class_connect()) connect: client 243224f9-f297-4a07-ab60-b6a19179afcf, cookie 0xcfd8b3ae4b165cc1 00002000:00100000:0.0:1782224430.277223:0:14856:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 243224f9-f297-4a07-ab60-b6a19179afcf/ffff96e98798f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782224430.277241:0:14856:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1782224430.277480:0:14856:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782224430.277500:0:14856:0:(import.c:65:import_set_state_nolock()) ffff96e987988800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782224430.277529:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:243224f9-f297-4a07-ab60-b6a19179afcf+6:2345:x1868797312084736:12345-192.168.202.7@tcp:8:mount.lustre.0 Request processed in 381us (1551us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224430.277536:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:2.0:1782224430.277759:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312084864 00000100:00100000:2.0:1782224430.277767:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312084864 00000100:00100000:2.0:1782224430.277812:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:2.0:1782224430.277821:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:243224f9-f297-4a07-ab60-b6a19179afcf+6:13707:x1868797312084864:12345-192.168.202.7@tcp:33:mount.lustre.0 00000004:00080000:1.0:1782224430.281566:0:14222:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3655us 00000004:00200000:2.0:1782224430.293431:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1782224430.293670:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:243224f9-f297-4a07-ab60-b6a19179afcf+6:13707:x1868797312084864:12345-192.168.202.7@tcp:33:mount.lustre.0 Request processed in 15842us (17726us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224430.293684:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:1.0:1782224430.477242:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224430.477364:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312084992 00000100:00100000:2.0:1782224430.477378:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312084992 00000100:00100000:2.0:1782224430.477461:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:2.0:1782224430.477476:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+6:13752:x1868797312084992:12345-192.168.202.7@tcp:101:mkdir.0 00010000:00010000:2.0:1782224430.477507:0:14879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224430.477543:0:14879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b165cc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51997 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224430.477633:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b165ccf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224430.477649:0:14879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b165ccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224430.477664:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b165ccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224430.477940:0:14879:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782224430.477945:0:14879:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224430.478095:0:14879:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b165ccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224430.478130:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaac00/0xcfd8b3ae4b165cc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51997 expref: 8 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224430.478151:0:14879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b165ccf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51997 expref: 7 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224430.478161:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:2.0:1782224430.478164:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782224430.478169:0:14879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaa600, rc 0) 00000100:00100000:2.0:1782224430.478266:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+7:13752:x1868797312084992:12345-192.168.202.7@tcp:101:mkdir.0 Request processed in 793us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224430.478275:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 8 00010000:00010000:2.0:1782224430.740905:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782224431.270353:0:6608:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 243224f9-f297-4a07-ab60-b6a19179afcf 00000100:00100000:0.0:1782224431.700444:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333052928:0@lo:400:kworker.0 00000100:00100000:0.0:1782224431.700516:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224431.700582:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333053440:0@lo:400:kworker.0 00000100:00100000:0.0:1782224431.700607:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224431.700629:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782224431.700635:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3306:1868797333052800:0@lo:400:kworker.0 00000100:00100000:0.0:1782224431.700660:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224431.700679:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1868797333053312:0@lo:400:kworker.0 00000100:00100000:0.0:1782224431.700699:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224431.700724:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333053056:0@lo:400:kworker.0 00000100:00100000:0.0:1782224431.700747:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224431.700778:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782224431.700784:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797333053184:0@lo:400:kworker.0 00000100:00100000:0.0:1782224431.700806:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224431.700836:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333052928 00000100:00100000:0.0:1782224431.700843:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333052928 00000100:00100000:0.0:1782224431.700892:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333053056 00000100:00100000:0.0:1782224431.700908:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333053056 00000100:00100000:0.0:1782224431.701064:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782224431.701085:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333052928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224431.701138:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333052928:12345-0@lo:400:kworker.0 Request processed in 55us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224431.701146:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782224431.701163:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782224431.701168:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333053056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224431.701211:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333053056:12345-0@lo:400:kworker.0 Request processed in 43us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224431.701217:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782224431.701234:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333053440 00000100:00100000:0.0:1782224431.701238:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333053440 00000100:00100000:0.0:1782224431.701264:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333053312 00000100:00100000:0.0:1782224431.701267:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333053312 00000100:00100000:0.0:1782224431.701280:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333053184 00000100:00100000:0.0:1782224431.701284:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333053184 00000100:00100000:0.0:1782224431.701300:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782224431.701305:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797333053440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224431.701332:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797333053440:12345-0@lo:400:kworker.0 Request processed in 27us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224431.701338:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782224431.701349:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782224431.701354:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868797333053312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224431.701381:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868797333053312:12345-0@lo:400:kworker.0 Request processed in 26us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224431.701387:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782224431.701420:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782224431.701425:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797333053184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224431.701454:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868797333053184:12345-0@lo:400:kworker.0 Request processed in 29us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224431.701460:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1782224431.701482:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782224431.701487:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782224431.701489:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782224431.701514:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868797333053184:0@lo:400:kworker.0 00000100:00100000:0.0:1782224431.701525:0:3303:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1782224431.701539:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333053056:0@lo:400:kworker.0 00000100:00100000:2.0:1782224431.701678:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333052800 00000100:00100000:2.0:1782224431.701686:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333052800 00000100:00100000:2.0:1782224431.701715:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782224431.701721:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:3306:x1868797333052800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224431.701769:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:3306:x1868797333052800:12345-0@lo:400:kworker.0 Request processed in 48us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224431.701775:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782224431.701881:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3306:1868797333052800:0@lo:400:kworker.0 00000100:00100000:2.0:1782224431.701904:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1868797333053312:0@lo:400:kworker.0 00000100:00100000:2.0:1782224431.701913:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333052928:0@lo:400:kworker.0 00000100:00100000:2.0:1782224431.701928:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333053440:0@lo:400:kworker.0 00000100:00100000:2.0:1782224431.704064:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782224431.704084:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96e987c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333053568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782224431.705050:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224431.705571:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333053568 00000100:00100000:1.0:1782224431.705586:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333053568 00000100:00100000:1.0:1782224431.705638:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782224431.705647:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333053568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782224431.705672:0:14858:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224431.705737:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333053568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224431.705810:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782224431.706410:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96e987c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333053568:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1782224431.752843:0:7486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 243224f9-f297-4a07-ab60-b6a19179afcf 00010000:00010000:1.0:1782224431.770001:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782224432.638123:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224432.638241:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312085120 00000100:00100000:2.0:1782224432.638252:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312085120 00000100:00100000:2.0:1782224432.638330:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:2.0:1782224432.638341:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+7:13804:x1868797312085120:12345-192.168.202.7@tcp:41:lfs.0 00000004:00000024:2.0:1782224432.638387:0:14220:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1782224432.638479:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+7:13804:x1868797312085120:12345-192.168.202.7@tcp:41:lfs.0 Request processed in 139us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224432.638486:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00080000:0.0:1782224432.638912:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224432.642789:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224432.650463:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312085248 00000100:00100000:2.0:1782224432.650479:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312085248 00000100:00100000:2.0:1782224432.650563:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:2.0:1782224432.650573:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:243224f9-f297-4a07-ab60-b6a19179afcf+5:13804:x1868797312085248:12345-192.168.202.7@tcp:13:lfs.0 00002000:00000024:2.0:1782224432.650613:0:14858:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224432.650722:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:243224f9-f297-4a07-ab60-b6a19179afcf+5:13804:x1868797312085248:12345-192.168.202.7@tcp:13:lfs.0 Request processed in 150us (7942us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224432.650730:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00080000:0.0:1782224432.650812:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782224432.655153:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224432.656479:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312085376 00000100:00100000:2.0:1782224432.656494:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312085376 00000100:00100000:2.0:1782224432.656589:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:2.0:1782224432.656614:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:243224f9-f297-4a07-ab60-b6a19179afcf+5:13804:x1868797312085376:12345-192.168.202.7@tcp:13:lfs.0 00002000:00000024:2.0:1782224432.656653:0:14858:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782224432.656745:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:243224f9-f297-4a07-ab60-b6a19179afcf+5:13804:x1868797312085376:12345-192.168.202.7@tcp:13:lfs.0 Request processed in 135us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224432.656752:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00080000:0.0:1782224432.656827:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782224432.794296:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224432.901818:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224432.901951:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312085504 00000100:00100000:1.0:1782224432.901963:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312085504 00000100:00100000:1.0:1782224432.905351:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 92 00000100:00100000:1.0:1782224432.905380:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+10:13837:x1868797312085504:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782224432.905400:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224432.905422:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eaa7d55600/0xcfd8b3ae4b165cd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a5199e expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224432.905455:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eaa7d55600/0xcfd8b3ae4b165cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5199e expref: 11 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224432.905466:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eaa7d55600/0xcfd8b3ae4b165cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5199e expref: 11 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224432.905474:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d55600, rc 0) 00000100:00100000:1.0:1782224432.905554:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+11:13837:x1868797312085504:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 189us (3749us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224432.905579:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 92 00000100:00100000:3.0:1782224432.913758:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224432.916935:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312085632 00000100:00100000:2.0:1782224432.916951:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312085632 00000100:00100000:2.0:1782224432.917009:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 93 00000100:00100000:2.0:1782224432.917032:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+11:13837:x1868797312085632:12345-192.168.202.7@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782224432.917351:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+11:13837:x1868797312085632:12345-192.168.202.7@tcp:501:mount.lustre.0 Request processed in 332us (3601us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224432.917359:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 93 00000100:00100000:3.0:1782224432.933452:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224432.933625:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312085760 00000100:00100000:2.0:1782224432.933638:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312085760 00000100:00100000:2.0:1782224432.933711:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 94 00000100:00100000:2.0:1782224432.933722:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+11:13837:x1868797312085760:12345-192.168.202.7@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782224432.934010:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+11:13837:x1868797312085760:12345-192.168.202.7@tcp:503:mount.lustre.0 Request processed in 289us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224432.934057:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 94 00000100:00100000:3.0:1782224432.944184:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224432.944293:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312085888 00000100:00100000:0.0:1782224432.944303:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312085888 00000100:00100000:0.0:1782224432.944362:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 95 00000100:00100000:0.0:1782224432.944371:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+11:13843:x1868797312085888:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782224432.944647:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+11:13843:x1868797312085888:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 276us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224432.944655:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 95 00000100:00100000:3.0:1782224432.963752:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224432.963901:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312086016 00000100:00100000:1.0:1782224432.963913:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312086016 00000100:00100000:1.0:1782224432.963974:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 96 00000100:00100000:1.0:1782224432.963985:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+11:13843:x1868797312086016:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782224432.964334:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+11:13843:x1868797312086016:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 349us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224432.964342:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 96 00000100:00100000:3.0:1782224432.973110:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224432.973403:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312086144 00000100:00100000:2.0:1782224432.973414:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312086144 00000100:00100000:2.0:1782224432.973478:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 97 00000100:00100000:2.0:1782224432.973488:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+11:13837:x1868797312086144:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782224432.973508:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224432.973543:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbbaac00/0xcfd8b3ae4b165cdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a519c8 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224432.973574:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbbaac00/0xcfd8b3ae4b165cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519c8 expref: 12 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224432.973585:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbbaac00/0xcfd8b3ae4b165cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519c8 expref: 12 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224432.973596:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbbaac00, rc 0) 00000100:00100000:2.0:1782224432.973659:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+12:13837:x1868797312086144:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 172us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224432.973668:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 97 00000100:00100000:3.0:1782224432.976180:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224432.976287:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312086272 00000100:00100000:0.0:1782224432.976298:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312086272 00000100:00100000:0.0:1782224432.976363:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 98 00000100:00100000:0.0:1782224432.976392:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf73a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+12:13837:x1868797312086272:12345-192.168.202.7@tcp:256:mount.lustre.0 20000000:01000000:0.0:1782224432.976423:0:14213:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782224432.976444:0:14213:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782224432.976448:0:14213:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782224432.976451:0:14213:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782224432.976454:0:14213:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1782224432.977859:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf73a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+12:13837:x1868797312086272:12345-192.168.202.7@tcp:256:mount.lustre.0 Request processed in 1461us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224432.977871:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 98 00000100:00100000:3.0:1782224432.980426:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224432.981251:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312086400 00000100:00100000:1.0:1782224432.981265:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312086400 00000100:00100000:1.0:1782224432.981391:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 99 00000100:00100000:1.0:1782224432.981404:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf73b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+12:13837:x1868797312086400:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782224432.981424:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224432.981449:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eaa7d54600/0xcfd8b3ae4b165ce4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a519cf expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224432.981483:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eaa7d54600/0xcfd8b3ae4b165ce4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519cf expref: 13 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224432.981507:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eaa7d54600/0xcfd8b3ae4b165ce4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519cf expref: 13 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224432.981515:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d54600, rc 0) 00000100:00100000:1.0:1782224432.981666:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf73b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:13837:x1868797312086400:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 264us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224432.981681:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 99 00000100:00100000:3.0:1782224432.983669:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224432.983760:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312086528 00000100:00100000:1.0:1782224432.983771:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312086528 00000100:00100000:1.0:1782224432.983823:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 100 00000100:00100000:1.0:1782224432.983833:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf73a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:13837:x1868797312086528:12345-192.168.202.7@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782224432.989965:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf73a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:13837:x1868797312086528:12345-192.168.202.7@tcp:501:mount.lustre.0 Request processed in 6119us (6292us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224432.989982:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 100 00000100:00100000:3.0:1782224432.993615:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224432.993785:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312086656 00000100:00100000:2.0:1782224432.993795:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312086656 00000100:00100000:2.0:1782224432.993893:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 101 00000100:00100000:2.0:1782224432.993905:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf73bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:13837:x1868797312086656:12345-192.168.202.7@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782224432.994371:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf73bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:13837:x1868797312086656:12345-192.168.202.7@tcp:503:mount.lustre.0 Request processed in 467us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224432.994380:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 101 00000100:00100000:0.0:1782224432.999580:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224432.999696:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312086784 00000100:00100000:1.0:1782224432.999709:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312086784 00000100:00100000:1.0:1782224432.999776:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 102 00000100:00100000:1.0:1782224432.999788:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:13846:x1868797312086784:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782224433.000453:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:13846:x1868797312086784:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 666us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224433.000464:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 102 00000100:00100000:3.0:1782224433.005434:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224433.005848:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312086912 00000100:00100000:2.0:1782224433.005927:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312086912 00000100:00100000:2.0:1782224433.006085:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 103 00000100:00100000:2.0:1782224433.006096:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf73b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:13846:x1868797312086912:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782224433.007221:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf73b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:13846:x1868797312086912:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 1117us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224433.007235:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 103 00000100:00100000:3.0:1782224433.021263:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224433.021316:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224433.021401:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224433.021966:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312087680 00000100:00100000:1.0:1782224433.021978:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312087680 00000100:00100000:1.0:1782224433.022074:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312087552 00000100:00100000:1.0:1782224433.022078:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312087552 00000100:00100000:1.0:1782224433.022100:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:1.0:1782224433.022110:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:243224f9-f297-4a07-ab60-b6a19179afcf+5:2349:x1868797312087680:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224433.022219:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:243224f9-f297-4a07-ab60-b6a19179afcf+5:2349:x1868797312087680:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 109us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224433.022227:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:1.0:1782224433.022246:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:1.0:1782224433.022253:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:243224f9-f297-4a07-ab60-b6a19179afcf+5:2349:x1868797312087552:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224433.022300:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:243224f9-f297-4a07-ab60-b6a19179afcf+5:2349:x1868797312087552:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 48us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224433.022307:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:2.0:1782224433.022750:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312087424 00000100:00100000:2.0:1782224433.022756:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312087424 00000100:00100000:2.0:1782224433.022801:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:2.0:1782224433.022809:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+7:2349:x1868797312087424:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224433.022859:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+7:2349:x1868797312087424:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 46us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224433.022866:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:3.0:1782224433.027420:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224433.027842:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312087040 00000100:00100000:2.0:1782224433.027917:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312087040 00000100:00100000:2.0:1782224433.027963:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:2.0:1782224433.027972:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2345:x1868797312087040:12345-192.168.202.7@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782224433.028003:0:14220:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 32540eb9-2a68-4f6c-84ca-a9039e746d4c@192.168.202.7@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:2.0:1782224433.029171:0:14220:0:(genops.c:1406:class_connect()) connect: client 32540eb9-2a68-4f6c-84ca-a9039e746d4c, cookie 0xcfd8b3ae4b165ceb 00000004:00100000:2.0:1782224433.029215:0:14220:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1782224433.029364:0:14220:0:(import.c:65:import_set_state_nolock()) ffff96e985f77000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782224433.029452:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:2345:x1868797312087040:12345-192.168.202.7@tcp:38:mount.lustre.0 Request processed in 1477us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224433.029461:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:3.0:1782224433.039402:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224433.039450:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224433.039782:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312087296 00000100:00100000:2.0:1782224433.039791:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312087296 00000100:00100000:1.0:1782224433.039949:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312087168 00000100:00100000:1.0:1782224433.039953:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312087168 00000100:00100000:1.0:1782224433.040046:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:1.0:1782224433.040057:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+7:0:x1868797312087168:12345-192.168.202.7@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782224433.040100:0:14219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782224433.040179:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+7:0:x1868797312087168:12345-192.168.202.7@tcp:41:mount.lustre.0 Request processed in 124us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224433.040187:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:2.0:1782224433.041386:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:2.0:1782224433.041402:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:13837:x1868797312087296:12345-192.168.202.7@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782224433.041429:0:14879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1782224433.041482:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:13837:x1868797312087296:12345-192.168.202.7@tcp:41:mount.lustre.0 Request processed in 84us (2091us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224433.041489:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00080000:0.0:1782224433.045403:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224433.054693:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224433.054858:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312087808 00000100:00100000:2.0:1782224433.054868:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312087808 00000100:00100000:2.0:1782224433.054935:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:2.0:1782224433.054945:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:13837:x1868797312087808:12345-192.168.202.7@tcp:40:mount.lustre.0 00000100:00100000:2.0:1782224433.055212:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:13837:x1868797312087808:12345-192.168.202.7@tcp:40:mount.lustre.0 Request processed in 267us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224433.055220:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:3.0:1782224433.058624:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224433.058732:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224433.059575:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224433.059987:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312088192 00000100:00100000:3.0:1782224433.060001:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312088192 00000100:00100000:3.0:1782224433.060096:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:3.0:1782224433.060108:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:13837:x1868797312088192:12345-192.168.202.7@tcp:33:mount.lustre.0 00000004:00200000:3.0:1782224433.060416:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1782224433.060722:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:13837:x1868797312088192:12345-192.168.202.7@tcp:33:mount.lustre.0 Request processed in 614us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224433.060730:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:1.0:1782224433.064865:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312087936 00000100:00100000:1.0:1782224433.064880:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312087936 00000100:00100000:1.0:1782224433.064945:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312088064 00000100:00100000:1.0:1782224433.064948:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312088064 00000100:00100000:1.0:1782224433.064967:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:1.0:1782224433.064976:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1868797312087936:12345-192.168.202.7@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782224433.065010:0:14855:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 32540eb9-2a68-4f6c-84ca-a9039e746d4c@192.168.202.7@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:1.0:1782224433.066893:0:14855:0:(genops.c:1406:class_connect()) connect: client 32540eb9-2a68-4f6c-84ca-a9039e746d4c, cookie 0xcfd8b3ae4b165cf2 00002000:00100000:1.0:1782224433.066916:0:14855:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 32540eb9-2a68-4f6c-84ca-a9039e746d4c/ffff96ea916d3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782224433.066934:0:14855:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1782224433.067360:0:14855:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782224433.067402:0:14855:0:(import.c:65:import_set_state_nolock()) ffff96ea916d5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782224433.068191:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:2345:x1868797312087936:12345-192.168.202.7@tcp:8:mount.lustre.0 Request processed in 3210us (9575us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224433.068218:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:1.0:1782224433.068252:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:1.0:1782224433.068260:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1868797312088064:12345-192.168.202.7@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782224433.068287:0:14855:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 32540eb9-2a68-4f6c-84ca-a9039e746d4c@192.168.202.7@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:1.0:1782224433.068313:0:14855:0:(genops.c:1406:class_connect()) connect: client 32540eb9-2a68-4f6c-84ca-a9039e746d4c, cookie 0xcfd8b3ae4b165cf9 00002000:00100000:1.0:1782224433.068322:0:14855:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 32540eb9-2a68-4f6c-84ca-a9039e746d4c/ffff96ea916d7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782224433.068331:0:14855:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1782224433.068573:0:14855:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782224433.068595:0:14855:0:(import.c:65:import_set_state_nolock()) ffff96eabf388800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782224433.068632:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:2345:x1868797312088064:12345-192.168.202.7@tcp:8:mount.lustre.0 Request processed in 371us (9899us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224433.068639:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:2.0:1782224433.209362:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224433.210066:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312088320 00000100:00100000:3.0:1782224433.210077:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312088320 00000100:00100000:3.0:1782224433.210145:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:3.0:1782224433.210157:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:13867:x1868797312088320:12345-192.168.202.7@tcp:101:mkdir.0 00010000:00010000:3.0:1782224433.210208:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224433.210432:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675000/0xcfd8b3ae4b165d00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a519f9 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224433.210823:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165d07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224433.210839:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165d07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224433.211048:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165d07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224433.212319:0:14221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782224433.212327:0:14221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1782224433.213328:0:14221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165d07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224433.214122:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675000/0xcfd8b3ae4b165d00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519f9 expref: 8 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224433.214152:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165d07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519f9 expref: 7 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224433.214173:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:3.0:1782224433.214176:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782224433.214181:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675200, rc 0) 00000100:00100000:3.0:1782224433.214275:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32540eb9-2a68-4f6c-84ca-a9039e746d4c+7:13867:x1868797312088320:12345-192.168.202.7@tcp:101:mkdir.0 Request processed in 4119us (4934us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224433.214284:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 14 00010000:00010000:1.0:1782224433.817224:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224434.260559:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782224434.260587:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333053696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782224434.260691:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224434.260945:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333053696 00000100:00100000:1.0:1782224434.260954:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333053696 00000100:00100000:1.0:1782224434.261044:0:14859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782224434.261055:0:14859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333053696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782224434.261091:0:14859:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224434.261139:0:14859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333053696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224434.261147:0:14859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1782224434.261348:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782224434.261383:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333053696:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782224434.836957:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782224435.355216:0:5808:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 243224f9-f297-4a07-ab60-b6a19179afcf 00000001:00100000:0.0:1782224435.355234:0:5808:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 32540eb9-2a68-4f6c-84ca-a9039e746d4c 00010000:00010000:1.0:1782224435.860203:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782224436.176541:0:16084:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1782224436.363487:0:6608:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 32540eb9-2a68-4f6c-84ca-a9039e746d4c 00000100:00100000:1.0:1782224436.821292:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333053824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782224436.821382:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224436.821705:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333053824 00000100:00100000:1.0:1782224436.821715:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333053824 00000100:00100000:1.0:1782224436.821779:0:14859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782224436.821788:0:14859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333053824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782224436.821824:0:14859:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224436.821864:0:14859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333053824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224436.821871:0:14859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1782224436.821890:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782224436.821926:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333053824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782224436.822853:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3306:1868797333053952:0@lo:400:kworker.0 00000100:00100000:2.0:1782224436.822907:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224436.822934:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333054464:0@lo:400:kworker.0 00000100:00100000:2.0:1782224436.822959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224436.822980:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782224436.822986:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1868797333054336:0@lo:400:kworker.0 00000100:00100000:2.0:1782224436.823006:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224436.823045:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333054080:0@lo:400:kworker.0 00000100:00100000:1.0:1782224436.828268:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333053952 00000100:00100000:1.0:1782224436.828282:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333053952 00000100:00100000:1.0:1782224436.828339:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782224436.828357:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:3306:x1868797333053952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224436.828468:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:3306:x1868797333053952:12345-0@lo:400:kworker.0 Request processed in 112us (5561us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224436.828481:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782224436.828576:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333054464 00000100:00100000:1.0:1782224436.828580:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333054464 00000100:00100000:1.0:1782224436.828628:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333054336 00000100:00100000:1.0:1782224436.828631:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333054336 00000100:00100000:1.0:1782224436.828661:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782224436.828689:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797333054464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224436.828722:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868797333054464:12345-0@lo:400:kworker.0 Request processed in 55us (5763us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224436.828729:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782224436.828747:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782224436.828752:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868797333054336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224436.828775:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868797333054336:12345-0@lo:400:kworker.0 Request processed in 24us (5769us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224436.828780:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782224436.828802:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868797333054208:0@lo:400:kworker.0 00000100:00100000:1.0:1782224436.828833:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224436.828866:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333054208 00000100:00100000:1.0:1782224436.828870:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333054208 00000100:00100000:1.0:1782224436.828887:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782224436.828893:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868797333054208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224436.828923:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868797333054208:12345-0@lo:400:kworker.0 Request processed in 30us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224436.828928:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1782224436.828940:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224436.828964:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868797333054208:0@lo:400:kworker.0 00000100:00100000:2.0:1782224436.829110:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224436.829171:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1868797333054336:0@lo:400:kworker.0 00000100:00100000:2.0:1782224436.829204:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3306:1868797333053952:0@lo:400:kworker.0 00000100:00100000:2.0:1782224436.829217:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1868797333054464:0@lo:400:kworker.0 00000100:00100000:1.0:1782224436.829754:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333054080 00000100:00100000:1.0:1782224436.829760:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333054080 00000100:00100000:1.0:1782224436.829821:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782224436.829845:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333054080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782224436.829893:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333054080:12345-0@lo:400:kworker.0 Request processed in 50us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224436.829898:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1782224436.830121:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782224436.830481:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333054080:0@lo:400:kworker.0 00000001:00100000:2.0:1782224436.882212:0:7486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 32540eb9-2a68-4f6c-84ca-a9039e746d4c 00010000:00010000:2.0:1782224436.885916:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224437.926578:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224438.286546:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224438.286601:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224438.286636:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224438.286672:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224438.286690:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224438.286707:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224438.286728:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224438.286852:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312088576 00000100:00100000:2.0:1782224438.286864:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312088576 00000100:00100000:2.0:1782224438.286944:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312088960 00000100:00100000:2.0:1782224438.286948:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312088960 00000100:00100000:2.0:1782224438.286976:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:2.0:1782224438.286986:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+6:2349:x1868797312088576:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224438.287096:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+6:2349:x1868797312088576:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 112us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224438.287105:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:2.0:1782224438.287140:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00100000:2.0:1782224438.287147:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:2349:x1868797312088960:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224438.287171:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:2349:x1868797312088960:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 26us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224438.287177:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00100000:2.0:1782224438.287196:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312088448 00000100:00100000:2.0:1782224438.287199:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312088448 00000100:00100000:2.0:1782224438.287224:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 105 00000100:00100000:2.0:1782224438.287230:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf73b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:2349:x1868797312088448:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224438.287266:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf73b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:2349:x1868797312088448:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 36us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224438.287287:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 105 00000100:00080000:3.0:1782224438.287599:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782224438.287671:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312088832 00000100:00100000:0.0:1782224438.287675:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312088832 00000100:00100000:0.0:1782224438.287741:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312089088 00000100:00100000:0.0:1782224438.287744:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312089088 00000100:00100000:1.0:1782224438.287832:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312088704 00000100:00100000:1.0:1782224438.287835:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312088704 00000100:00100000:2.0:1782224438.291606:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312089216 00000100:00100000:2.0:1782224438.291622:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312089216 00000100:00080000:3.0:1782224438.292080:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782224438.295010:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:0.0:1782224438.295052:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:243224f9-f297-4a07-ab60-b6a19179afcf+5:2349:x1868797312088832:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224438.295166:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:243224f9-f297-4a07-ab60-b6a19179afcf+5:2349:x1868797312088832:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 122us (8564us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224438.295173:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:0.0:1782224438.295192:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:0.0:1782224438.295199:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+5:2349:x1868797312089088:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224438.295225:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+5:2349:x1868797312089088:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 28us (8589us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224438.295249:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:1.0:1782224438.303099:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:1.0:1782224438.303143:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:243224f9-f297-4a07-ab60-b6a19179afcf+5:2349:x1868797312088704:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224438.303236:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:243224f9-f297-4a07-ab60-b6a19179afcf+5:2349:x1868797312088704:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 99us (16544us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224438.303245:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:2.0:1782224438.306228:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:2.0:1782224438.306244:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+5:2349:x1868797312089216:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224438.306332:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+5:2349:x1868797312089216:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 92us (19601us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224438.306340:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00080000:2.0:1782224438.306415:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782224438.935261:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224439.380513:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782224439.380704:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333054592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782224439.380776:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224439.380915:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333054592 00000100:00100000:1.0:1782224439.380924:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333054592 00000100:00100000:1.0:1782224439.381080:0:14859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782224439.381090:0:14859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333054592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782224439.381143:0:14859:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224439.381210:0:14859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333054592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224439.381219:0:14859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782224439.381338:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333054592:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782224439.381746:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1782224439.808978:0:16233:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd827e87b0 20000000:00000080:1.0:1782224439.808994:0:16233:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96e984dbdc00 uarg=0000000000000000 20000000:01000000:1.0:1782224439.809195:0:16233:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782224439.809202:0:16233:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782224439.809207:0:16233:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1782224439.810306:0:16234:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1782224439.810875:0:16233:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1782224439.814472:0:16233:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782224439.814505:0:16233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b165d0e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224439.814525:0:16233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea90675c00/0xcfd8b3ae4b165a05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b1659fe expref: 18 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224439.814534:0:16233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b165a52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165a4b expref: 18 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224439.814541:0:16233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96ea90674c00/0xcfd8b3ae4b165b8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165b86 expref: 18 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224439.814552:0:16233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96eabbbabe00/0xcfd8b3ae4b165cac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5196d expref: 12 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224439.814560:0:16233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96eaa7d54600/0xcfd8b3ae4b165ce4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519cf expref: 12 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224439.814583:0:16233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b165d0e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224439.814686:0:16233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96eaa7d54600/0xcfd8b3ae4b165ce4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519cf expref: 12 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224439.814704:0:16233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96eaa7d54600/0xcfd8b3ae4b165ce4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519cf expref: 12 pid: 14214 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224439.814835:0:16233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf59f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16233:1868797333054720:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224439.815206:0:16233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96eabbbabe00/0xcfd8b3ae4b165cac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5196d expref: 12 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224439.815217:0:16233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96eabbbabe00/0xcfd8b3ae4b165cac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5196d expref: 12 pid: 14212 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224439.815226:0:16233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf59c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16233:1868797333054848:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224439.815258:0:16233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea90674c00/0xcfd8b3ae4b165b8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b165b86 expref: 18 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224439.815266:0:16233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96ea90674c00/0xcfd8b3ae4b165b8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b165b86 expref: 18 pid: 14214 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224439.815274:0:16233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf59ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16233:1868797333054976:0@lo:104: 00000100:00100000:3.0:1782224439.815425:0:16233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782224439.815470:0:16233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b165a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b165a4b expref: 18 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224439.815479:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333054976 00000100:00100000:1.0:1782224439.815487:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333054976 00010000:00010000:3.0:1782224439.815489:0:16233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b165a52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b165a4b expref: 18 pid: 14213 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224439.815497:0:16233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf59e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16233:1868797333055104:0@lo:104: 00000100:00100000:3.0:1782224439.815521:0:16233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782224439.815551:0:16233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96ea90675c00/0xcfd8b3ae4b165a05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcfd8b3ae4b1659fe expref: 18 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224439.815558:0:16233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96ea90675c00/0xcfd8b3ae4b165a05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659fe expref: 18 pid: 14214 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224439.815566:0:16233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf59ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16233:1868797333055232:0@lo:104: 00000100:00100000:3.0:1782224439.815589:0:16233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224439.815604:0:16233:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea88076cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782224439.815807:0:14203:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782224439.815819:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333055104 00000100:00100000:1.0:1782224439.815822:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333055104 00000100:00100000:1.0:1782224439.815836:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333055232 00000100:00100000:1.0:1782224439.815839:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333055232 00000100:00100000:1.0:1782224439.815851:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224439.815860:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+5:16233:x1868797333054976:12345-0@lo:104: 00010000:00010000:1.0:1782224439.815875:0:14203:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eabbb87600/0xcfd8b3ae4b165b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b165b8d expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.815944:0:14203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782224439.815950:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+5:16233:x1868797333054976:12345-0@lo:104: Request processed in 91us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224439.815958:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224439.815978:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782224439.815984:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+4:16233:x1868797333055104:12345-0@lo:104: 00010000:00010000:1.0:1782224439.815992:0:14203:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55e00/0xcfd8b3ae4b165a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b165a52 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816085:0:14203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782224439.816089:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+4:16233:x1868797333055104:12345-0@lo:104: Request processed in 106us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224439.816095:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782224439.816119:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782224439.816125:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea88984450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+3:16233:x1868797333055232:12345-0@lo:104: 00010000:00010000:1.0:1782224439.816133:0:14203:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b165a05 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816158:0:14203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782224439.816162:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea88984450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+3:16233:x1868797333055232:12345-0@lo:104: Request processed in 38us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224439.816167:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1782224439.816208:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782224439.816214:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eabbb87600/0xcfd8b3ae4b165b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b165b8d expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816221:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87600 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:1.0:1782224439.816232:0:14208:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eabbb87600/0xcfd8b3ae4b165b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b165b8d expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816242:0:14208:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eabbb87600/0xcfd8b3ae4b165b86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b165b8d expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224439.816249:0:14208:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eabbb87600/0xcfd8b3ae4b165b86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b165b8d expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224439.816255:0:14208:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782224439.816284:0:14208:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eabbb87600/0xcfd8b3ae4b165b86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b165b8d expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816290:0:14208:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782224439.816310:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eabbb87600/0xcfd8b3ae4b165b86 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b165b8d expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816317:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eabbb87600/0xcfd8b3ae4b165b86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b165b8d expref: -99 pid: 15523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816328:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782224439.816331:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55e00/0xcfd8b3ae4b165a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b165a52 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816337:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55e00 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:1.0:1782224439.816339:0:14208:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55e00/0xcfd8b3ae4b165a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b165a52 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816344:0:14208:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55e00/0xcfd8b3ae4b165a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b165a52 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224439.816361:0:14208:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55e00/0xcfd8b3ae4b165a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b165a52 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224439.816366:0:14208:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782224439.816380:0:14208:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55e00/0xcfd8b3ae4b165a4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b165a52 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816385:0:14208:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782224439.816401:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55e00/0xcfd8b3ae4b165a4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b165a52 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816407:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eaa7d55e00/0xcfd8b3ae4b165a4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b165a52 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816415:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782224439.816418:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcfd8b3ae4b165a05 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816423:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54a00 already unused, calling callback (ffffffffc1ad4c20) 10000000:00010000:1.0:1782224439.816425:0:14208:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcfd8b3ae4b165a05 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816431:0:14208:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcfd8b3ae4b165a05 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782224439.816437:0:14208:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcfd8b3ae4b165a05 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782224439.816441:0:14208:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782224439.816460:0:14208:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b165a05 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816465:0:14208:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782224439.816472:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b165a05 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816478:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff96eaa7d54a00/0xcfd8b3ae4b1659fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcfd8b3ae4b165a05 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816490:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224439.816492:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782224439.816494:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224439.816502:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782224439.816513:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3303:1868797333055360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782224439.816545:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224439.816572:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3305:1868797333055488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782224439.816596:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224439.816611:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782224439.816616:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3305:1868797333055616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782224439.816638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224439.816671:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333055360 00000100:00100000:1.0:1782224439.816676:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333055360 00010000:00010000:1.0:1782224439.816697:0:14206:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea90674c00/0xcfd8b3ae4b165b8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b165b86 expref: 19 pid: 14214 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224439.816712:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333055488 00000100:00100000:1.0:1782224439.816714:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333055488 00010000:00010000:1.0:1782224439.816723:0:14206:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b165a52 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b165a4b expref: 20 pid: 14213 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224439.816746:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333055616 00000100:00100000:1.0:1782224439.816749:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333055616 00010000:00010000:1.0:1782224439.816759:0:14206:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96ea90675c00/0xcfd8b3ae4b165a05 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659fe expref: 21 pid: 14214 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224439.816770:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224439.816777:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+21:3303:x1868797333055360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782224439.816787:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224439.816792:0:14206:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea90674c00/0xcfd8b3ae4b165b8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b165b86 expref: 21 pid: 14214 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816801:0:14206:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea90674c00/0xcfd8b3ae4b165b8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b165b86 expref: 21 pid: 14214 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816816:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224439.816843:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+21:3303:x1868797333055360:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224439.816850:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782224439.816862:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782224439.816868:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+20:3305:x1868797333055488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782224439.816875:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224439.816879:0:14206:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b165a52 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b165a4b expref: 20 pid: 14213 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816888:0:14206:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b165a52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b165a4b expref: 20 pid: 14213 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816897:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224439.816925:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+20:3305:x1868797333055488:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224439.816932:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782224439.816943:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782224439.816948:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7f7a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:3305:x1868797333055616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782224439.816954:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782224439.816958:0:14206:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96ea90675c00/0xcfd8b3ae4b165a05 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659fe expref: 19 pid: 14214 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816965:0:14206:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96ea90675c00/0xcfd8b3ae4b165a05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659fe expref: 19 pid: 14214 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224439.816975:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782224439.816994:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7f7a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:3305:x1868797333055616:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224439.817001:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782224439.817084:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3303:1868797333055360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782224439.817124:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3305:1868797333055616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782224439.817132:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3305:1868797333055488:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782224439.817537:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224439.818167:0:16233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90674c00/0xcfd8b3ae4b165b8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b165b86 expref: 18 pid: 14214 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224439.818186:0:16233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf59ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16233:1868797333054976:0@lo:104: 00010000:00010000:2.0:1782224439.818196:0:16233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90674400/0xcfd8b3ae4b165a52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b165a4b expref: 17 pid: 14213 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224439.818205:0:16233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf59e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16233:1868797333055104:0@lo:104: 00010000:00010000:2.0:1782224439.818214:0:16233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90675c00/0xcfd8b3ae4b165a05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcfd8b3ae4b1659fe expref: 16 pid: 14214 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224439.818224:0:16233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf59ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16233:1868797333055232:0@lo:104: 00000100:00100000:2.0:1782224439.819238:0:16233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf59f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16233:1868797333054720:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224439.819238:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224439.819247:0:16233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf59c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16233:1868797333054848:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224439.819293:0:16233:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b165d0e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224439.819317:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224439.819360:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312089344 00000100:00100000:3.0:1782224439.819366:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312089344 00010000:00010000:3.0:1782224439.819398:0:14206:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96eaa7d54600/0xcfd8b3ae4b165ce4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519cf expref: 13 pid: 14214 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224439.819498:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312089472 00000100:00100000:3.0:1782224439.819502:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312089472 00010000:00010000:3.0:1782224439.819516:0:14206:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96eabbbabe00/0xcfd8b3ae4b165cac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5196d expref: 14 pid: 14212 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224439.819998:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:0.0:1782224439.820009:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+14:2346:x1868797312089344:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224439.820209:0:14204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224439.820217:0:14204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96eaa7d54600/0xcfd8b3ae4b165ce4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519cf expref: 14 pid: 14214 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224439.820230:0:14204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96eaa7d54600/0xcfd8b3ae4b165ce4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519cf expref: 14 pid: 14214 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224439.820248:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eaa7d54600/0xcfd8b3ae4b165ce4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519cf expref: 14 pid: 14214 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224439.820264:0:14204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224439.820325:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:2346:x1868797312089344:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 317us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224439.820334:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:0.0:1782224439.820353:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:0.0:1782224439.820360:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+12:2346:x1868797312089472:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224439.820372:0:14204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224439.820378:0:14204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96eabbbabe00/0xcfd8b3ae4b165cac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5196d expref: 12 pid: 14212 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224439.820386:0:14204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96eabbbabe00/0xcfd8b3ae4b165cac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5196d expref: 12 pid: 14212 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224439.820408:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96eabbbabe00/0xcfd8b3ae4b165cac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a5196d expref: 12 pid: 14212 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224439.820418:0:14204:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b165d0e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224439.820425:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b165d0e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224439.820722:0:14204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b165d0e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224439.820730:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b165d0e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224439.820736:0:14204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b165d0e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224439.820743:0:14204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b165d0e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224439.820749:0:14204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674000 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:0.0:1782224439.820753:0:14204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b165d0e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224439.820761:0:14204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b165d0e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224439.821977:0:16233:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b165d0e lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224439.821993:0:16233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b165d0e lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224439.823569:0:14204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b165d0e lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224439.823602:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96ea90674000/0xcfd8b3ae4b165d0e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224439.823842:0:14204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224439.823959:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+11:2346:x1868797312089472:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 3593us (4635us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224439.823969:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 8 00010000:00010000:1.0:1782224439.962875:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782224440.405771:0:14253:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782224440.980247:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224441.101771:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224441.101872:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312089600 00000100:00100000:3.0:1782224441.101884:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312089600 00000100:00100000:3.0:1782224441.101944:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 106 00000100:00100000:3.0:1782224441.101955:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+11:13721:x1868797312089600:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782224441.101985:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224441.102006:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea90674e00/0xcfd8b3ae4b165d15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a00 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224441.102067:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90674e00/0xcfd8b3ae4b165d15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a00 expref: 12 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224441.102078:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea90674e00/0xcfd8b3ae4b165d15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a00 expref: 12 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224441.102097:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674e00, rc 0) 00000100:00100000:3.0:1782224441.102156:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+12:13721:x1868797312089600:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 Request processed in 203us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224441.102164:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 106 00000100:00100000:2.0:1782224441.112847:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224441.112936:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312089728 00000100:00100000:3.0:1782224441.112948:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312089728 00000100:00100000:3.0:1782224441.113010:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 107 00000100:00100000:3.0:1782224441.113046:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf73ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+12:13721:x1868797312089728:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224441.113356:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf73ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+12:13721:x1868797312089728:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 Request processed in 311us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224441.113364:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 107 00000100:00100000:3.0:1782224441.116934:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224441.117056:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312089856 00000100:00100000:2.0:1782224441.117066:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312089856 00000100:00100000:2.0:1782224441.117131:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 108 00000100:00100000:2.0:1782224441.117141:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+12:13721:x1868797312089856:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782224441.117362:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+12:13721:x1868797312089856:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 Request processed in 220us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224441.117370:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 108 00000100:00100000:0.0:1782224441.135092:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224441.135395:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312089984 00000100:00100000:3.0:1782224441.135406:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312089984 00000100:00100000:3.0:1782224441.135473:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 109 00000100:00100000:3.0:1782224441.135484:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf73a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+12:13721:x1868797312089984:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782224441.135502:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224441.135533:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96ea90675000/0xcfd8b3ae4b165d1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a07 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224441.135563:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96ea90675000/0xcfd8b3ae4b165d1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a07 expref: 13 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224441.135574:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96ea90675000/0xcfd8b3ae4b165d1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a07 expref: 13 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224441.135583:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675000, rc 0) 00000100:00100000:3.0:1782224441.135645:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf73a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:13721:x1868797312089984:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 Request processed in 163us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224441.135652:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 109 00000100:00100000:2.0:1782224441.158641:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224441.158778:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312090112 00000100:00100000:1.0:1782224441.158790:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312090112 00000100:00100000:1.0:1782224441.158850:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 110 00000100:00100000:1.0:1782224441.158862:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:13721:x1868797312090112:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782224441.168549:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:13721:x1868797312090112:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 Request processed in 9674us (9904us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224441.168565:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 110 10000000:01000000:2.0:1782224441.175479:0:14216:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782224441.175489:0:14216:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96eabfcb1000 from 10 10000000:01000000:2.0:1782224441.175496:0:14216:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782224441.175550:0:14216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbbab200/0xcfd8b3ae4b165d23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224441.175565:0:14216:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabbbab200/0xcfd8b3ae4b165d23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224441.175577:0:14216:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabbbab200/0xcfd8b3ae4b165d23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224441.175631:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333055744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782224441.175702:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224441.175754:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905f2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782224441.176177:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333055744 00000100:00100000:0.0:1782224441.176185:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333055744 00000100:00100000:0.0:1782224441.176237:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782224441.176246:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+16:14216:x1868797333055744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782224441.176260:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224441.176273:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eabbb86800/0xcfd8b3ae4b165d2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b165d23 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224441.176298:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eabbb86800/0xcfd8b3ae4b165d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165d23 expref: 17 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224441.176308:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eabbb86800/0xcfd8b3ae4b165d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165d23 expref: 17 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224441.176316:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbb86800, rc 0) 00000100:00100000:0.0:1782224441.176365:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+17:14216:x1868797333055744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224441.176371:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782224441.176418:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333055744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782224441.176443:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabbbab200/0xcfd8b3ae4b165d23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165d2a expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224441.176451:0:14216:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabbbab200/0xcfd8b3ae4b165d23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b165d2a expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224441.176506:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86106a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333055872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782224441.176535:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224441.176555:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea89171300 going to sleep for 11 seconds 00000100:00100000:1.0:1782224441.176831:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333055872 00000100:00100000:1.0:1782224441.176836:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333055872 00000100:00100000:1.0:1782224441.176869:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782224441.176877:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+17:14216:x1868797333055872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782224441.177156:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+17:14216:x1868797333055872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224441.177163:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782224441.177193:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86106a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333055872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782224441.177221:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333056000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782224441.177254:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224441.177266:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eabfca5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782224441.177276:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333056000 00000100:00100000:1.0:1782224441.177279:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333056000 00000100:00100000:1.0:1782224441.177292:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782224441.177296:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+17:14216:x1868797333056000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782224441.177419:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+17:14216:x1868797333056000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224441.177425:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782224441.177454:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333056000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782224441.178549:0:16286:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1782224441.188966:0:14216:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1782224441.189008:0:14216:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782224441.189512:0:14216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbbab200/0xcfd8b3ae4b165d23 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165d2a expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224441.189528:0:14216:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabbbab200/0xcfd8b3ae4b165d23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165d2a expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224441.189543:0:14216:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782224441.189545:0:14216:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96ea9c4a6000 from 10 10000000:01000000:2.0:1782224441.189548:0:14216:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782224441.189596:0:14216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa400/0xcfd8b3ae4b165d31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224441.189611:0:14216:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa400/0xcfd8b3ae4b165d31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224441.189623:0:14216:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa400/0xcfd8b3ae4b165d31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224441.189650:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333056128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782224441.189725:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224441.189771:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905f2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782224441.189872:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333056128 00000100:00100000:1.0:1782224441.189893:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333056128 00000100:00100000:1.0:1782224441.189944:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1782224441.189953:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+17:14216:x1868797333056128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782224441.189967:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224441.189979:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eaa7d54200/0xcfd8b3ae4b165d38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b165d31 expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224441.190005:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eaa7d54200/0xcfd8b3ae4b165d38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165d31 expref: 18 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224441.190180:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eaa7d54200/0xcfd8b3ae4b165d38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165d31 expref: 18 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224441.190190:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d54200, rc 0) 00000100:00100000:1.0:1782224441.190231:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+18:14216:x1868797333056128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 279us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224441.190238:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782224441.190359:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333056128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782224441.190374:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa400/0xcfd8b3ae4b165d31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165d38 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224441.190391:0:14216:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa400/0xcfd8b3ae4b165d31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b165d38 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224441.190446:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333056256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782224441.190473:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224441.190532:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905f2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782224441.199437:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224441.203757:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333056256 00000100:00100000:1.0:1782224441.203773:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333056256 00000100:00100000:1.0:1782224441.203877:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312090240 00000100:00100000:1.0:1782224441.203882:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312090240 00000100:00100000:1.0:1782224441.203908:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782224441.203919:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+18:14216:x1868797333056256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782224441.204305:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 116 00000100:00100000:0.0:1782224441.204315:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:13721:x1868797312090240:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782224441.204514:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:13721:x1868797312090240:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 Request processed in 201us (5088us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224441.204522:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 116 00000100:00100000:1.0:1782224441.204755:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+18:14216:x1868797333056256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 838us (14281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224441.204762:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1782224441.205138:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333056256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782224441.205187:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86106d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333056384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782224441.205233:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224441.205269:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea89171600 going to sleep for 11 seconds 00000100:00100000:2.0:1782224441.205649:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333056384 00000100:00100000:2.0:1782224441.205655:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333056384 00000100:00100000:2.0:1782224441.205695:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1782224441.205702:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+18:14216:x1868797333056384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782224441.205844:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+18:14216:x1868797333056384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224441.205851:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1782224441.205879:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86106d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333056384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782224441.217616:0:16288:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1782224441.222590:0:14216:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1782224441.222627:0:14216:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782224441.222643:0:14216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa400/0xcfd8b3ae4b165d31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165d38 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224441.222658:0:14216:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabbbaa400/0xcfd8b3ae4b165d31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165d38 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782224441.222670:0:14216:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782224441.222673:0:14216:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff96ea8512c800 from 10 10000000:01000000:2.0:1782224441.222676:0:14216:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782224441.222720:0:14216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbbabe00/0xcfd8b3ae4b165d3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224441.222742:0:14216:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff96eabbbabe00/0xcfd8b3ae4b165d3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224441.222755:0:14216:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff96eabbbabe00/0xcfd8b3ae4b165d3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224441.222783:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333056512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782224441.222855:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224441.222943:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905f2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782224441.227431:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333056512 00000100:00100000:1.0:1782224441.227450:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333056512 00000100:00100000:1.0:1782224441.227584:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1782224441.227596:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+18:14216:x1868797333056512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782224441.227616:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224441.227635:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96eaa7d55200/0xcfd8b3ae4b165d46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd8b3ae4b165d3f expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224441.227665:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96eaa7d55200/0xcfd8b3ae4b165d46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165d3f expref: 19 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224441.227677:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96eaa7d55200/0xcfd8b3ae4b165d46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcfd8b3ae4b165d3f expref: 19 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224441.227688:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d55200, rc 0) 00000100:00100000:1.0:1782224441.227778:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:14216:x1868797333056512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (4922us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224441.227785:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1782224441.227954:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333056512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782224441.227976:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff96eabbbabe00/0xcfd8b3ae4b165d3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165d46 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224441.227988:0:14216:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff96eabbbabe00/0xcfd8b3ae4b165d3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcfd8b3ae4b165d46 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224441.228337:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86104000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333056640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782224441.228381:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224441.228439:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea89171600 going to sleep for 11 seconds 00000100:00100000:3.0:1782224441.228878:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333056640 00000100:00100000:3.0:1782224441.228885:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333056640 00000100:00100000:3.0:1782224441.228927:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1782224441.228937:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:14216:x1868797333056640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224441.231293:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:14216:x1868797333056640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2348us (2902us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224441.231306:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1782224441.231374:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86104000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333056640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782224441.231509:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf59c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333056768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782224441.231561:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224441.231610:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8820f900 going to sleep for 11 seconds 00000100:00100000:1.0:1782224441.231798:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333056768 00000100:00100000:1.0:1782224441.231806:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333056768 00000100:00100000:1.0:1782224441.231843:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1782224441.231850:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:14216:x1868797333056768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782224441.232009:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:14216:x1868797333056768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224441.232695:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf59c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:14216:1868797333056768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782224441.233167:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000040:00080000:3.0:1782224441.234119:0:16290:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1782224441.234273:0:14216:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1782224441.234296:0:14216:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782224441.234309:0:14216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff96eabbbabe00/0xcfd8b3ae4b165d3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165d46 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224441.234322:0:14216:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff96eabbbabe00/0xcfd8b3ae4b165d3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcfd8b3ae4b165d46 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224441.945179:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333057024:0@lo:400:kworker.0 00000100:00100000:0.0:1782224441.945257:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224441.945318:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782224441.945325:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333056896:0@lo:400:kworker.0 00000100:00100000:0.0:1782224441.945349:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224441.945366:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1868797333057408:0@lo:400:kworker.0 00000100:00100000:0.0:1782224441.945392:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224441.945428:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333057152:0@lo:400:kworker.0 00000100:00100000:0.0:1782224441.945452:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224441.945469:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782224441.945475:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea86107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797333057280:0@lo:400:kworker.0 00000100:00100000:0.0:1782224441.945498:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224441.945529:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333057024 00000100:00100000:0.0:1782224441.945537:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333057024 00000100:00100000:0.0:1782224441.945603:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333056896 00000100:00100000:0.0:1782224441.945607:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333056896 00000100:00100000:0.0:1782224441.945631:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782224441.945641:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86104a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333057024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224441.945700:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86104a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333057024:12345-0@lo:400:kworker.0 Request processed in 59us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224441.945708:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782224441.945725:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782224441.945742:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86107b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333056896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224441.945772:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86107b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333056896:12345-0@lo:400:kworker.0 Request processed in 31us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224441.945778:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782224441.945821:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333056896:0@lo:400:kworker.0 00000100:00100000:0.0:1782224441.945833:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333057024:0@lo:400:kworker.0 00000100:00100000:2.0:1782224441.946112:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333057408 00000100:00100000:2.0:1782224441.946117:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333057408 00000100:00100000:2.0:1782224441.946148:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333057152 00000100:00100000:2.0:1782224441.946150:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333057152 00000100:00100000:2.0:1782224441.946163:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333057280 00000100:00100000:2.0:1782224441.946165:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333057280 00000100:00100000:2.0:1782224441.946180:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782224441.946186:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868797333057408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224441.946229:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868797333057408:12345-0@lo:400:kworker.0 Request processed in 43us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224441.946236:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782224441.946257:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782224441.946263:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333057152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224441.946296:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868797333057152:12345-0@lo:400:kworker.0 Request processed in 33us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224441.946302:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782224441.946313:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782224441.946336:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797333057280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782224441.946362:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868797333057280:12345-0@lo:400:kworker.0 Request processed in 43us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224441.946367:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1782224441.946389:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782224441.946394:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782224441.946396:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782224441.946433:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1868797333057280:0@lo:400:kworker.0 00000100:00100000:2.0:1782224441.946443:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868797333057152:0@lo:400:kworker.0 00000100:00100000:2.0:1782224441.946468:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea86105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1868797333057408:0@lo:400:kworker.0 00000100:00100000:3.0:1782224441.947580:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782224441.947609:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf59c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333057536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782224441.947664:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224441.947704:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333057536 00000100:00100000:3.0:1782224441.947709:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333057536 00000100:00100000:3.0:1782224441.947749:0:14859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782224441.947757:0:14859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333057536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782224441.947787:0:14859:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224441.947826:0:14859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1868797333057536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224441.947833:0:14859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782224441.947871:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf59c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1868797333057536:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782224442.007504:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782224443.029958:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224443.349259:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.349948:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312090368 00000100:00100000:2.0:1782224443.349961:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312090368 00000100:00100000:2.0:1782224443.350077:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:2.0:1782224443.350088:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+6:14377:x1868797312090368:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782224443.350109:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224443.350128:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b165d4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a0e expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.350195:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165d54 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.350225:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165d54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.350239:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165d54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.350269:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2e00/0xcfd8b3ae4b165d5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.350278:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2e00/0xcfd8b3ae4b165d5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.350284:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2e00/0xcfd8b3ae4b165d5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782224443.350537:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782224443.351092:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3a00/0xcfd8b3ae4b165d62 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.351105:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3a00/0xcfd8b3ae4b165d62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.351114:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3a00/0xcfd8b3ae4b165d62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224443.351200:0:14220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1782224443.351205:0:14220:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224443.351306:0:14220:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3a00/0xcfd8b3ae4b165d62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.351319:0:14220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165d54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.351336:0:14220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165d54 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.351343:0:14220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165d54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.351349:0:14220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbbaae00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224443.351354:0:14220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165d54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.351362:0:14220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165d54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.351374:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:2.0:1782224443.351377:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224443.351382:0:14220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165d54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.351387:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaae00/0xcfd8b3ae4b165d54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.351399:0:14220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2e00/0xcfd8b3ae4b165d5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.351404:0:14220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2e00/0xcfd8b3ae4b165d5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.351409:0:14220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2e00/0xcfd8b3ae4b165d5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.351414:0:14220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabf2f2e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224443.351422:0:14220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2e00/0xcfd8b3ae4b165d5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.351427:0:14220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2e00/0xcfd8b3ae4b165d5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.351435:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff96ea8635fe00) 00010000:00010000:2.0:1782224443.351438:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224443.351441:0:14220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2e00/0xcfd8b3ae4b165d5b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.352667:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2e00/0xcfd8b3ae4b165d5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.352743:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa200/0xcfd8b3ae4b165d4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a0e expref: 8 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.352760:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3a00/0xcfd8b3ae4b165d62 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a0e expref: 7 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.352781:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96ea8635f200) 00010000:00010000:2.0:1782224443.352785:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782224443.352788:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabf2f3a00, rc 0) 00000100:00100000:2.0:1782224443.353642:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+7:14377:x1868797312090368:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 3550us (4389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224443.353654:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:2.0:1782224443.376618:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224443.376724:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312090624 00000100:00100000:0.0:1782224443.376735:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312090624 00000100:00100000:0.0:1782224443.376798:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:0.0:1782224443.376820:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:243224f9-f297-4a07-ab60-b6a19179afcf+7:14377:x1868797312090624:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782224443.376843:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224443.376868:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b165d69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a15 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.376954:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b165d70 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.376968:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b165d70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.376979:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b165d70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.376992:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b165d77 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.376998:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b165d77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.377049:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b165d77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.378273:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87400/0xcfd8b3ae4b165d7e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.378291:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87400/0xcfd8b3ae4b165d7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.378299:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87400/0xcfd8b3ae4b165d7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224443.378310:0:14221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1782224443.379680:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b165d70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.379695:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b165d70 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.379703:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b165d70 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.379709:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224443.379713:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b165d70 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.379721:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b165d70 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.379736:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96ea8635f200) 00010000:00010000:0.0:1782224443.379739:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224443.379753:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b165d70 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.379759:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b165d70 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.380407:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b165d77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.380415:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b165d77 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.380420:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b165d77 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.380425:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86e00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224443.380428:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b165d77 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.380507:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b165d77 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.380518:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96ea8309b000) 00010000:00010000:0.0:1782224443.380521:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224443.380525:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b165d77 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.380530:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b165d77 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.382351:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b165d69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a15 expref: 10 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.382391:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87400/0xcfd8b3ae4b165d7e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a15 expref: 9 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.382400:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96ea8309b500) 00010000:00010000:0.0:1782224443.382403:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224443.382406:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbb87400, rc 0) 00000100:00100000:0.0:1782224443.384144:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:243224f9-f297-4a07-ab60-b6a19179afcf+9:14377:x1868797312090624:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 7316us (7526us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1782224443.384157:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:1.0:1782224443.400397:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224443.400461:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312090752 00000100:00100000:3.0:1782224443.400472:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312090752 00000100:00100000:3.0:1782224443.400531:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:3.0:1782224443.400542:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:243224f9-f297-4a07-ab60-b6a19179afcf+9:14383:x1868797312090752:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1782224443.400564:0:14219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224443.400592:0:14219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b165d8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a1c expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.400661:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165d93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.400675:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165d93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.400686:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165d93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.400717:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165d9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.400725:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.400732:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.400998:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165d93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.401008:0:14219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165d93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.401039:0:14219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165d93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.401046:0:14219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224443.401051:0:14219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165d93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.401060:0:14219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165d93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.401088:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:3.0:1782224443.401092:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224443.401096:0:14219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165d93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.401103:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165d93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.401126:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.401131:0:14219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165d9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.401136:0:14219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165d9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.401141:0:14219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224443.401144:0:14219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165d9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.401149:0:14219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165d9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.401155:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96ea87df7500) 00010000:00010000:3.0:1782224443.401157:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224443.401160:0:14219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165d9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.401176:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165d9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.401210:0:14219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b165d8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a1c expref: 10 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.401220:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:3.0:1782224443.401223:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224443.401233:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b165d8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a1c expref: 10 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.401243:0:14219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674200, rc 0) 00000100:00100000:3.0:1782224443.401476:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:243224f9-f297-4a07-ab60-b6a19179afcf+9:14383:x1868797312090752:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 935us (1088us total) trans 0 rc 301/301 00000100:00100000:3.0:1782224443.401485:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:2.0:1782224443.406927:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.406970:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.406999:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.407083:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.407104:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.407124:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.407151:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.407170:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.407194:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312091008 00000100:00100000:2.0:1782224443.407204:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312091008 00000100:00100000:2.0:1782224443.407250:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312091520 00000100:00100000:2.0:1782224443.407253:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312091520 00000100:00100000:2.0:1782224443.407287:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 28 00000100:00100000:2.0:1782224443.407298:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:2347:x1868797312091520:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224443.407384:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:2347:x1868797312091520:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 88us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224443.407407:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 28 00000100:00100000:2.0:1782224443.407426:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:2.0:1782224443.407432:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+9:14377:x1868797312091008:12345-192.168.202.7@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1782224443.407490:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+9:14377:x1868797312091008:12345-192.168.202.7@tcp:59:lhsmtool_posix.0 Request processed in 57us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224443.407496:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:2.0:1782224443.407519:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312091264 00000100:00100000:2.0:1782224443.407523:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312091264 00000100:00100000:2.0:1782224443.407542:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312091392 00000100:00100000:2.0:1782224443.407545:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312091392 00000100:00100000:2.0:1782224443.407556:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312091776 00000100:00100000:2.0:1782224443.407557:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312091776 00000100:00100000:2.0:1782224443.407565:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312091648 00000100:00100000:2.0:1782224443.407567:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312091648 00000100:00100000:2.0:1782224443.407575:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:2.0:1782224443.407584:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:243224f9-f297-4a07-ab60-b6a19179afcf+5:2347:x1868797312091264:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224443.407604:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:243224f9-f297-4a07-ab60-b6a19179afcf+5:2347:x1868797312091264:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 21us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224443.407608:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:2.0:1782224443.407617:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:2.0:1782224443.407620:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:243224f9-f297-4a07-ab60-b6a19179afcf+5:2346:x1868797312091392:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224443.407632:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:243224f9-f297-4a07-ab60-b6a19179afcf+5:2346:x1868797312091392:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 12us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224443.407635:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:2.0:1782224443.407641:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:2.0:1782224443.407644:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+5:2347:x1868797312091776:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224443.407654:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+5:2347:x1868797312091776:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 10us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224443.407657:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:2.0:1782224443.407663:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:2.0:1782224443.407666:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+5:2346:x1868797312091648:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224443.407679:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+5:2346:x1868797312091648:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 13us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224443.407683:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:3.0:1782224443.408078:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312091136 00000100:00100000:3.0:1782224443.408085:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312091136 00000100:00100000:3.0:1782224443.408118:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 121 00000100:00100000:3.0:1782224443.408125:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:2346:x1868797312091136:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1782224443.408148:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:2346:x1868797312091136:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 25us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224443.408153:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 121 00000100:00080000:3.0:1782224443.408201:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782224443.408205:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782224443.408208:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782224443.408336:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312090880 00000100:00100000:1.0:1782224443.408341:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312090880 00000100:00100000:1.0:1782224443.408376:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:1.0:1782224443.408402:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:243224f9-f297-4a07-ab60-b6a19179afcf+9:14383:x1868797312090880:12345-192.168.202.7@tcp:700:lfs.0 00000100:00100000:1.0:1782224443.408442:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:243224f9-f297-4a07-ab60-b6a19179afcf+9:14383:x1868797312090880:12345-192.168.202.7@tcp:700:lfs.0 Request processed in 53us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224443.408450:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:0.0:1782224443.412975:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.413360:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312092032 00000100:00100000:2.0:1782224443.413372:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312092032 00000100:00100000:2.0:1782224443.413526:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:2.0:1782224443.413537:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+9:14383:x1868797312092032:12345-192.168.202.7@tcp:36:lfs.0 00010000:00010000:2.0:1782224443.413676:0:14879:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224443.413703:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbbaa600/0xcfd8b3ae4b165ccf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51997 expref: 9 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.413722:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:2.0:1782224443.413728:0:14879:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224443.414003:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165da1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.414144:0:14879:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165d07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519f9 expref: 5 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.414156:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165da1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.414191:0:14879:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165d07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519f9 expref: 5 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.414205:0:14879:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165d07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519f9 expref: 5 pid: 14221 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224443.414221:0:14879:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d22a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14879:1868797333057664:192.168.202.7@tcp:104: 00000100:00100000:2.0:1782224443.414334:0:14879:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90cac540 going to sleep for 11 seconds 00000100:00100000:1.0:1782224443.421087:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.421248:0:14879:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d22a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14879:1868797333057664:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224443.421281:0:14879:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165da1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224443.421553:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312092160 00000100:00100000:3.0:1782224443.421560:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312092160 00010000:00010000:3.0:1782224443.421664:0:14205:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165d07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519f9 expref: 6 pid: 14221 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224443.421735:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:3.0:1782224443.421747:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:2347:x1868797312092160:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224443.421766:0:14205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224443.421773:0:14205:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165d07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519f9 expref: 6 pid: 14221 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.421804:0:14205:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165d07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519f9 expref: 6 pid: 14221 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.421828:0:14205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165d07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a519f9 expref: 6 pid: 14221 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.421847:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:3.0:1782224443.421852:0:14205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165da1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.421863:0:14205:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165da1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.421871:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165da1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.421899:0:14205:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224443.421962:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+5:2347:x1868797312092160:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 216us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224443.421970:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00010000:00010000:2.0:1782224443.422419:0:14879:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165da1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.422438:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165da1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.422462:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165da8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.422473:0:14879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165da8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.422482:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165da8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224443.425116:0:14879:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1782224443.425135:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165da1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.425146:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165da1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.425154:0:14879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165da1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.425161:0:14879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabf2f3c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224443.425165:0:14879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165da1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.425173:0:14879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165da1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.425190:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:2.0:1782224443.425193:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224443.425377:0:14879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165da1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.425385:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165da1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782224443.425411:0:14879:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000644d3095 reply state 0000000026c119eb transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165da8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224443.425421:0:14879:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782224443.425591:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+10:14383:x1868797312092032:12345-192.168.202.7@tcp:36:lfs.0 Request processed in 12042us (12614us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1782224443.425602:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 19 00010000:00010000:2.0:1782224443.432453:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165da8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.432470:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165da8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.432478:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165da8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.432484:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabf2f2400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224443.432489:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165da8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.432497:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165da8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.432515:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96ea8635fe00) 00010000:00010000:2.0:1782224443.432519:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224443.432523:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165da8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.432544:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165da8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782224443.480226:0:14253:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782224443.500388:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.500603:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312092288 00000100:00100000:2.0:1782224443.500615:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312092288 00000100:00100000:2.0:1782224443.500679:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:2.0:1782224443.500691:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+9:14391:x1868797312092288:12345-192.168.202.7@tcp:101:lctl.0 00010000:00010000:2.0:1782224443.500720:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224443.500744:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165daf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a23 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.500817:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165db6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.500833:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.500844:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224443.500913:0:14220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782224443.500916:0:14220:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224443.500957:0:14220:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.500983:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165daf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a23 expref: 11 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.501001:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3c00/0xcfd8b3ae4b165db6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a23 expref: 10 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.501081:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fe00) 00010000:00010000:2.0:1782224443.501084:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782224443.501088:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabf2f3c00, rc 0) 00000100:00100000:2.0:1782224443.501165:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+10:14391:x1868797312092288:12345-192.168.202.7@tcp:101:lctl.0 Request processed in 475us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224443.501173:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:1.0:1782224443.523539:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224443.523721:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312092416 00000100:00100000:3.0:1782224443.523733:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312092416 00000100:00100000:3.0:1782224443.523840:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:3.0:1782224443.523853:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+5:14392:x1868797312092416:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1782224443.523877:0:14219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224443.523901:0:14219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165dbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a2a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.523985:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b165dc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.524000:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b165dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.524199:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b165dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224443.524263:0:14219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782224443.524267:0:14219:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1782224443.524295:0:14219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b165dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.524321:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165dbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a2a expref: 7 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.524340:0:14219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674200/0xcfd8b3ae4b165dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a2a expref: 6 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.524348:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fe00) 00010000:00010000:3.0:1782224443.524351:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782224443.524355:0:14219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674200, rc 0) 00000100:00100000:3.0:1782224443.524432:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:14392:x1868797312092416:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 583us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224443.524438:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:1.0:1782224443.527688:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.527824:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312092544 00000100:00100000:2.0:1782224443.527835:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312092544 00000100:00100000:2.0:1782224443.527897:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:2.0:1782224443.527909:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:14392:x1868797312092544:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1782224443.527928:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224443.527948:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165dcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a31 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528054:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165dd2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528078:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165dd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528089:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165dd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528105:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165dd9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528113:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528139:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528245:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3600/0xcfd8b3ae4b165de0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528253:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3600/0xcfd8b3ae4b165de0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528261:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3600/0xcfd8b3ae4b165de0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224443.528299:0:14220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1782224443.528303:0:14220:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224443.528328:0:14220:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3600/0xcfd8b3ae4b165de0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528341:0:14220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165dd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528348:0:14220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165dd2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528354:0:14220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165dd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528360:0:14220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabf2f2a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224443.528365:0:14220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165dd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528373:0:14220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165dd2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528457:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fe00) 00010000:00010000:2.0:1782224443.528460:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224443.528465:0:14220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165dd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528472:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165dd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528486:0:14220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528493:0:14220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165dd9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528498:0:14220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528504:0:14220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabf2f3200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224443.528507:0:14220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528513:0:14220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528520:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96ea8635f700) 00010000:00010000:2.0:1782224443.528522:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224443.528524:0:14220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165dd9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528529:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165dd9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528647:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165dcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a31 expref: 8 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528663:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3600/0xcfd8b3ae4b165de0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a31 expref: 7 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.528671:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96ea8635fd00) 00010000:00010000:2.0:1782224443.528673:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782224443.528676:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabf2f3600, rc 0) 00000100:00100000:2.0:1782224443.528806:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+7:14392:x1868797312092544:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 898us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224443.528815:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:0.0:1782224443.532680:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.532761:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312092800 00000100:00100000:2.0:1782224443.532770:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312092800 00000100:00100000:2.0:1782224443.532846:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:2.0:1782224443.532858:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32540eb9-2a68-4f6c-84ca-a9039e746d4c+7:14392:x1868797312092800:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1782224443.532880:0:14879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224443.532898:0:14879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3e00/0xcfd8b3ae4b165de7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a38 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224443.533044:0:14879:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1782224443.533166:0:14879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3e00/0xcfd8b3ae4b165de7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a38 expref: 9 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.533180:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fe00) 00010000:00010000:2.0:1782224443.533183:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782224443.533200:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3e00/0xcfd8b3ae4b165de7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a38 expref: 9 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.533217:0:14879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabf2f3e00, rc 0) 00000100:00100000:2.0:1782224443.533276:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32540eb9-2a68-4f6c-84ca-a9039e746d4c+8:14392:x1868797312092800:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 421us (606us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1782224443.533283:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:1.0:1782224443.535859:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.536005:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312093056 00000100:00100000:2.0:1782224443.536025:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312093056 00000100:00100000:2.0:1782224443.536106:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00100000:2.0:1782224443.536117:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32540eb9-2a68-4f6c-84ca-a9039e746d4c+8:14392:x1868797312093056:12345-192.168.202.7@tcp:36:lfs.0 00010000:00010000:2.0:1782224443.536178:0:14879:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224443.536207:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3600/0xcfd8b3ae4b165de0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a31 expref: 8 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.536225:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96ea8635fd00) 00010000:00010000:2.0:1782224443.536234:0:14879:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224443.536256:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165df5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.536269:0:14879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165df5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.536279:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165df5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782224443.536515:0:14879:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ae232fbf reply state 00000000ca73b546 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165df5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224443.536525:0:14879:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782224443.536554:0:14879:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1782224443.536977:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32540eb9-2a68-4f6c-84ca-a9039e746d4c+9:14392:x1868797312093056:12345-192.168.202.7@tcp:36:lfs.0 Request processed in 860us (1127us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1782224443.536986:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00100000:1.0:1782224443.539587:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.539658:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312093312 00000100:00100000:2.0:1782224443.539668:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312093312 00000100:00100000:2.0:1782224443.539731:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:2.0:1782224443.539741:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+9:14392:x1868797312093312:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:2.0:1782224443.539979:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+10:14392:x1868797312093312:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 238us (406us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1782224443.539987:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:1.0:1782224443.543211:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224443.543305:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312093568 00000100:00100000:3.0:1782224443.543314:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312093568 00000100:00100000:3.0:1782224443.543380:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 25 00000100:00100000:3.0:1782224443.543397:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+10:14392:x1868797312093568:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1782224443.543423:0:14219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224443.543443:0:14219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165dfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a3f expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543518:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165e03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543532:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165e03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543542:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165e03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543554:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543561:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543566:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224443.543703:0:14219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1782224443.543792:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165e03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543800:0:14219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165e03 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543806:0:14219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165e03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543818:0:14219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224443.543822:0:14219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165e03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543831:0:14219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165e03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543843:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fe00) 00010000:00010000:3.0:1782224443.543846:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224443.543849:0:14219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165e03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543855:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165e03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543872:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543878:0:14219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543884:0:14219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543889:0:14219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224443.543891:0:14219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543896:0:14219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543911:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96ea87df7500) 00010000:00010000:3.0:1782224443.543914:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224443.543916:0:14219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543922:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543958:0:14219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165dfc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a3f expref: 12 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543967:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fe00) 00010000:00010000:3.0:1782224443.543969:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782224443.543972:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165dfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a3f expref: 12 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.543981:0:14219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675200, rc 0) 00000100:00100000:3.0:1782224443.544374:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+11:14392:x1868797312093568:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 983us (1169us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1782224443.544383:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 25 00000100:00100000:1.0:1782224443.547272:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.547512:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312093696 00000100:00100000:2.0:1782224443.547522:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312093696 00000100:00100000:2.0:1782224443.547573:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 26 00000100:00100000:2.0:1782224443.547592:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32540eb9-2a68-4f6c-84ca-a9039e746d4c+11:14392:x1868797312093696:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1782224443.547615:0:14879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224443.547635:0:14879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e18 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a46 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.547730:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e1f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.547744:0:14879:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165df5 lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.547751:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e1f lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.547767:0:14879:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165df5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.547794:0:14879:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e1f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.547953:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165df5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.547961:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165df5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.547968:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165df5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.547973:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabf2f2400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224443.547977:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165df5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.547984:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165df5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.548008:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:0.0:1782224443.548044:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1782224443.548048:0:3290:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e1f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.548056:0:3290:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.548071:0:3290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e1f lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.548095:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165df5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.548101:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2400/0xcfd8b3ae4b165df5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.548329:0:14879:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.548337:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224443.548403:0:14879:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1782224443.548407:0:14879:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224443.548433:0:14879:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.548465:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e18 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a46 expref: 12 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.548480:0:14879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a46 expref: 11 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.548487:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:2.0:1782224443.548489:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782224443.548492:0:14879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabf2f2a00, rc 0) 00000100:00100000:2.0:1782224443.548565:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32540eb9-2a68-4f6c-84ca-a9039e746d4c+11:14392:x1868797312093696:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 974us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224443.548573:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 26 00000100:00100000:3.0:1782224443.551537:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.551842:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312093824 00000100:00100000:2.0:1782224443.551854:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312093824 00000100:00100000:2.0:1782224443.551918:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:2.0:1782224443.551946:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+11:14392:x1868797312093824:12345-192.168.202.7@tcp:37:lfs.0 00000100:00100000:2.0:1782224443.559603:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+11:14392:x1868797312093824:12345-192.168.202.7@tcp:37:lfs.0 Request processed in 7647us (8068us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224443.559619:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:2.0:1782224443.563277:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224443.563336:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312094080 00000100:00100000:0.0:1782224443.563348:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312094080 00000100:00100000:0.0:1782224443.563421:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:0.0:1782224443.563433:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf871c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+11:14392:x1868797312094080:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:0.0:1782224443.564729:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf871c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+12:14392:x1868797312094080:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 1290us (1455us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1782224443.564740:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:2.0:1782224443.629708:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224443.630012:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312094208 00000100:00100000:1.0:1782224443.630077:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312094208 00000100:00100000:1.0:1782224443.630145:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:1.0:1782224443.630157:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:243224f9-f297-4a07-ab60-b6a19179afcf+10:14398:x1868797312094208:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1782224443.630178:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224443.630203:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165e26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a4d expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630270:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165e2d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630284:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165e2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630297:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165e2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630311:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165e34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630335:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165e34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630343:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165e34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630729:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b165e3b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630739:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b165e3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630746:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b165e3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782224443.630777:0:14221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1782224443.630781:0:14221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782224443.630818:0:14221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b165e3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630830:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165e2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630836:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165e2d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630843:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165e2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630849:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54600 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224443.630853:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165e2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630870:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165e2d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630884:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fe00) 00010000:00010000:1.0:1782224443.630887:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224443.630892:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165e2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630898:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54600/0xcfd8b3ae4b165e2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630911:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165e34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630916:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165e34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630921:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165e34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630927:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224443.630929:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165e34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630935:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165e34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630941:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96ea83afd700) 00010000:00010000:1.0:1782224443.630944:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224443.630946:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165e34 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630962:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54a00/0xcfd8b3ae4b165e34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.630992:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165e26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a4d expref: 12 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.631005:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55e00/0xcfd8b3ae4b165e3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a4d expref: 11 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224443.631013:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:1.0:1782224443.631120:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782224443.631123:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d55e00, rc 0) 00000100:00100000:1.0:1782224443.631191:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:243224f9-f297-4a07-ab60-b6a19179afcf+11:14398:x1868797312094208:12345-192.168.202.7@tcp:101:bash.0 Request processed in 1035us (1495us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224443.631198:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:1.0:1782224443.636203:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224443.636460:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312094464 00000100:00100000:3.0:1782224443.636470:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312094464 00000100:00100000:3.0:1782224443.636534:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 28 00000100:00100000:3.0:1782224443.636545:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+11:14398:x1868797312094464:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:3.0:1782224443.636568:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224443.636600:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165e42 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a54 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.636759:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e49 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.636776:0:14220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e1f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a46 expref: 11 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.636786:0:14220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e49 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.636826:0:14220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a46 expref: 11 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224443.636840:0:14220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e1f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a46 expref: 11 pid: 14879 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224443.636855:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf59e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14220:1868797333057792:192.168.202.7@tcp:104: 00000100:00100000:3.0:1782224443.636957:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8820fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1782224443.641550:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224443.641713:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312094592 00000100:00100000:0.0:1782224443.641727:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312094592 00010000:00010000:0.0:1782224443.641773:0:14204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e1f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a46 expref: 12 pid: 14879 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224443.641837:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:0.0:1782224443.641848:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+12:2346:x1868797312094592:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224443.641866:0:14204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224443.641873:0:14204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e1f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a46 expref: 12 pid: 14879 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.641887:0:14204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e1f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a46 expref: 12 pid: 14879 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.641912:0:14204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:0.0:1782224443.641917:0:14204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e49 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.641928:0:14204:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.641936:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e49 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.641953:0:14204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224443.642060:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32540eb9-2a68-4f6c-84ca-a9039e746d4c+12:2346:x1868797312094592:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 169us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224443.642077:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00010000:00010000:2.0:1782224443.644741:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e1f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a46 expref: 11 pid: 14879 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224443.644768:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf59e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14220:1868797333057792:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224443.644794:0:14220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.644804:0:14220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.644810:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.644842:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e50 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.644854:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.644865:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.646002:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3600/0xcfd8b3ae4b165e57 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.646192:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3600/0xcfd8b3ae4b165e57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.646203:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3600/0xcfd8b3ae4b165e57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224443.646215:0:14220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782224443.646248:0:14220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.646255:0:14220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e49 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.646262:0:14220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e49 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.646268:0:14220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224443.646272:0:14220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e49 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.646280:0:14220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e49 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.646294:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:2.0:1782224443.646297:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224443.646302:0:14220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e49 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.646308:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165e49 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782224443.646322:0:14220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d4768a3 reply state 000000001c37f062 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224443.646337:0:14220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782224443.646527:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165e42 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a54 expref: 14 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.646547:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3600/0xcfd8b3ae4b165e57 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a54 expref: 13 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.646555:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:2.0:1782224443.646557:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1782224443.646559:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabf2f3600, rc 0) 00000100:00100000:2.0:1782224443.646724:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+14:14398:x1868797312094464:12345-192.168.202.7@tcp:101:bash.0 Request processed in 10181us (10532us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1782224443.646733:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 28 00010000:00010000:2.0:1782224443.653525:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.653547:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e50 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.653555:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e50 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.653561:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabf2f3200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224443.653566:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e50 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.653574:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e50 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.653622:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff96ea8635fd00) 00010000:00010000:2.0:1782224443.653624:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224443.653630:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e50 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.653637:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e50 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224443.662783:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.662979:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312094720 00000100:00100000:2.0:1782224443.662990:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312094720 00000100:00100000:2.0:1782224443.663349:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 29 00000100:00100000:2.0:1782224443.663360:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:243224f9-f297-4a07-ab60-b6a19179afcf+13:14398:x1868797312094720:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:2.0:1782224443.663457:0:14219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224443.663482:0:14219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e65 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a5b expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.663556:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e6c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.663571:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.663716:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224443.663756:0:14219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782224443.663760:0:14219:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224443.663776:0:14219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.663804:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.663829:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e65 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a5b expref: 15 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.663852:0:14219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a5b expref: 14 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.663860:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:2.0:1782224443.663863:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782224443.663866:0:14219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabf2f2a00, rc 0) 00000100:00100000:2.0:1782224443.663948:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:243224f9-f297-4a07-ab60-b6a19179afcf+14:14398:x1868797312094720:12345-192.168.202.7@tcp:101:bash.0 Request processed in 590us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224443.663956:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 29 00000100:00100000:3.0:1782224443.667424:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.667591:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312094976 00000100:00100000:2.0:1782224443.667604:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312094976 00000100:00100000:2.0:1782224443.667664:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:2.0:1782224443.667675:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:243224f9-f297-4a07-ab60-b6a19179afcf+14:14398:x1868797312094976:12345-192.168.202.7@tcp:35:bash.0 00000100:00100000:2.0:1782224443.668109:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:243224f9-f297-4a07-ab60-b6a19179afcf+15:14398:x1868797312094976:12345-192.168.202.7@tcp:35:bash.0 Request processed in 433us (697us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1782224443.668118:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:3.0:1782224443.784431:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.785009:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312095232 00000100:00100000:2.0:1782224443.785094:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312095232 00000100:00100000:2.0:1782224443.785179:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 30 00000100:00100000:2.0:1782224443.785190:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+15:14408:x1868797312095232:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1782224443.785232:0:14879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224443.785254:0:14879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a62 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224443.785377:0:14879:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1782224443.785509:0:14879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e73 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a62 expref: 17 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.785523:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96ea8635fe00) 00010000:00010000:2.0:1782224443.785526:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782224443.785532:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a62 expref: 17 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.785548:0:14879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabf2f3200, rc 0) 00000100:00100000:2.0:1782224443.785624:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+16:14408:x1868797312095232:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 436us (1204us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1782224443.785632:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 30 00000100:00100000:1.0:1782224443.796534:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.796686:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312095488 00000100:00100000:2.0:1782224443.796696:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312095488 00000100:00100000:2.0:1782224443.796756:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:2.0:1782224443.796766:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:243224f9-f297-4a07-ab60-b6a19179afcf+16:14408:x1868797312095488:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:2.0:1782224443.797222:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:243224f9-f297-4a07-ab60-b6a19179afcf+17:14408:x1868797312095488:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 455us (696us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1782224443.797230:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:1.0:1782224443.870731:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.870895:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312095744 00000100:00100000:2.0:1782224443.870908:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312095744 00000100:00100000:2.0:1782224443.870986:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 31 00000100:00100000:2.0:1782224443.871050:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:243224f9-f297-4a07-ab60-b6a19179afcf+17:14411:x1868797312095744:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1782224443.871086:0:14219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224443.871110:0:14219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e81 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a69 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.871218:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3e00/0xcfd8b3ae4b165e88 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.871233:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3e00/0xcfd8b3ae4b165e88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.871245:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3e00/0xcfd8b3ae4b165e88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224443.871257:0:14219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782224443.871396:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e81 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a69 expref: 20 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.871418:0:14219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3e00/0xcfd8b3ae4b165e88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a69 expref: 19 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.871427:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:2.0:1782224443.871431:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782224443.871434:0:14219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabf2f3e00, rc 0) 00000100:00100000:2.0:1782224443.871509:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:243224f9-f297-4a07-ab60-b6a19179afcf+19:14411:x1868797312095744:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 496us (788us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1782224443.871515:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 31 00000100:00100000:3.0:1782224443.879130:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224443.879191:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224443.885448:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312095872 00000100:00100000:2.0:1782224443.885462:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312095872 00000100:00100000:2.0:1782224443.885560:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 32 00000100:00100000:2.0:1782224443.885581:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+19:14411:x1868797312095872:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:2.0:1782224443.885657:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e96 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.885675:0:14879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.885687:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.885719:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.885725:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e96 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.885732:0:14879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.885739:0:14879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabf2f3200 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224443.885743:0:14879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.885750:0:14879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e96 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.885762:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:2.0:1782224443.885765:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782224443.885769:0:14879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e96 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224443.885785:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e96 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224443.885882:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+19:14411:x1868797312095872:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 313us (6765us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224443.885890:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 32 00000100:00100000:3.0:1782224443.888875:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224443.889253:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312096256 00000100:00100000:1.0:1782224443.889263:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312096256 00000100:00100000:1.0:1782224443.889324:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:1.0:1782224443.889334:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:243224f9-f297-4a07-ab60-b6a19179afcf+19:14411:x1868797312096256:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:1.0:1782224443.889769:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:243224f9-f297-4a07-ab60-b6a19179afcf+20:14411:x1868797312096256:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 435us (902us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1782224443.889779:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:0.0:1782224443.890787:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312096000 00000100:00100000:0.0:1782224443.890796:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312096000 00000100:00100000:0.0:1782224443.890864:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:0.0:1782224443.890874:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:243224f9-f297-4a07-ab60-b6a19179afcf+20:2347:x1868797312096000:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782224443.890901:0:14205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782224443.890926:0:14205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3e00/0xcfd8b3ae4b165e88 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a69 expref: 20 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224443.890947:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:0.0:1782224443.890952:0:14205:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782224443.890999:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:243224f9-f297-4a07-ab60-b6a19179afcf+19:2347:x1868797312096000:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 127us (11807us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224443.891007:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 0 00010000:00010000:0.0:1782224444.055703:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782224444.175809:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224444.176195:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312096512 00000100:00100000:2.0:1782224444.176206:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312096512 00000100:00100000:2.0:1782224444.176342:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:2.0:1782224444.176353:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:243224f9-f297-4a07-ab60-b6a19179afcf+19:14442:x1868797312096512:12345-192.168.202.7@tcp:101:cat.0 00010000:00010000:2.0:1782224444.176380:0:14219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224444.176411:0:14219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e9d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a70 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.176528:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2600/0xcfd8b3ae4b165ea4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.176542:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2600/0xcfd8b3ae4b165ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.176554:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2600/0xcfd8b3ae4b165ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224444.176566:0:14219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782224444.176732:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165e9d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a70 expref: 22 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.176756:0:14219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2600/0xcfd8b3ae4b165ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a70 expref: 21 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.176778:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:2.0:1782224444.176781:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782224444.176785:0:14219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabf2f2600, rc 0) 00000100:00100000:2.0:1782224444.176849:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:243224f9-f297-4a07-ab60-b6a19179afcf+21:14442:x1868797312096512:12345-192.168.202.7@tcp:101:cat.0 Request processed in 498us (1051us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1782224444.176857:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:1.0:1782224444.179978:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224444.180149:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224444.180254:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312096896 00000100:00100000:0.0:1782224444.180264:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312096896 00000100:00100000:0.0:1782224444.180315:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:0.0:1782224444.180330:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:243224f9-f297-4a07-ab60-b6a19179afcf+21:14442:x1868797312096896:12345-192.168.202.7@tcp:35:cat.0 00000100:00100000:0.0:1782224444.180610:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:243224f9-f297-4a07-ab60-b6a19179afcf+22:14442:x1868797312096896:12345-192.168.202.7@tcp:35:cat.0 Request processed in 281us (460us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1782224444.180625:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:3.0:1782224444.182425:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312096640 00000100:00100000:3.0:1782224444.182438:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312096640 00000100:00100000:3.0:1782224444.182562:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:3.0:1782224444.182572:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:243224f9-f297-4a07-ab60-b6a19179afcf+22:2348:x1868797312096640:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224444.182587:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224444.182626:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2600/0xcfd8b3ae4b165ea4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a70 expref: 22 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.182644:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:3.0:1782224444.182648:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224444.182701:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:243224f9-f297-4a07-ab60-b6a19179afcf+21:2348:x1868797312096640:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 131us (2731us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224444.182708:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:1.0:1782224444.265720:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224444.265971:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312097152 00000100:00100000:2.0:1782224444.265982:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312097152 00000100:00100000:2.0:1782224444.266120:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 34 00000100:00100000:2.0:1782224444.266132:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+21:14448:x1868797312097152:12345-192.168.202.7@tcp:101:dd.0 00010000:00010000:2.0:1782224444.266159:0:14879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224444.266181:0:14879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165eb2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a77 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.266309:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2200/0xcfd8b3ae4b165eb9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.266505:0:14879:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3600/0xcfd8b3ae4b165e57 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a54 expref: 22 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.266525:0:14879:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e6c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a5b expref: 22 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.266533:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2200/0xcfd8b3ae4b165eb9 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.266570:0:14879:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a5b expref: 22 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.266597:0:14879:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e6c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a5b expref: 22 pid: 14219 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224444.266621:0:14879:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14879:1868797333057920:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224444.267096:0:14879:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3600/0xcfd8b3ae4b165e57 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a54 expref: 22 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.267107:0:14879:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3600/0xcfd8b3ae4b165e57 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a54 expref: 22 pid: 14220 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224444.267116:0:14879:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d23800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14879:1868797333058048:192.168.202.7@tcp:104: 00000100:00100000:2.0:1782224444.267293:0:14879:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea90cac900 going to sleep for 11 seconds 00000100:00100000:2.0:1782224444.273313:0:14879:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14879:1868797333057920:192.168.202.7@tcp:104: 00000100:00100000:2.0:1782224444.273450:0:14879:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d23800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14879:1868797333058048:192.168.202.7@tcp:104: 00010000:00010000:2.0:1782224444.273479:0:14879:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2200/0xcfd8b3ae4b165eb9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224444.275311:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224444.275950:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224444.276214:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312097408 00000100:00100000:3.0:1782224444.276225:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312097408 00010000:00010000:3.0:1782224444.276269:0:14205:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3600/0xcfd8b3ae4b165e57 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a54 expref: 23 pid: 14220 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224444.276311:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312097280 00000100:00100000:3.0:1782224444.276314:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312097280 00010000:00010000:3.0:1782224444.276342:0:14205:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e6c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a5b expref: 24 pid: 14219 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224444.276360:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:3.0:1782224444.276371:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7f79450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:243224f9-f297-4a07-ab60-b6a19179afcf+24:2346:x1868797312097408:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224444.276389:0:14205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224444.276396:0:14205:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3600/0xcfd8b3ae4b165e57 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a54 expref: 24 pid: 14220 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.276428:0:14205:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3600/0xcfd8b3ae4b165e57 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a54 expref: 24 pid: 14220 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.276455:0:14205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3600/0xcfd8b3ae4b165e57 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a54 expref: 24 pid: 14220 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.276476:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:3.0:1782224444.276483:0:14205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2200/0xcfd8b3ae4b165eb9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.276491:0:14205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2200/0xcfd8b3ae4b165eb9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.276497:0:14205:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224444.276575:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7f79450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:243224f9-f297-4a07-ab60-b6a19179afcf+23:2346:x1868797312097408:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 205us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224444.276583:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:3.0:1782224444.277805:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:3.0:1782224444.277818:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86105880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:243224f9-f297-4a07-ab60-b6a19179afcf+22:2347:x1868797312097280:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224444.277830:0:14205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224444.277837:0:14205:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e6c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a5b expref: 22 pid: 14219 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.277851:0:14205:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a5b expref: 22 pid: 14219 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.277882:0:14205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2a00/0xcfd8b3ae4b165e6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a5b expref: 22 pid: 14219 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.277895:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:3.0:1782224444.277898:0:14205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2200/0xcfd8b3ae4b165eb9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.277907:0:14205:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2200/0xcfd8b3ae4b165eb9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.277914:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2200/0xcfd8b3ae4b165eb9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.277939:0:14205:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224444.277975:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86105880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:243224f9-f297-4a07-ab60-b6a19179afcf+21:2347:x1868797312097280:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 161us (2027us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224444.277983:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 12 00010000:00010000:3.0:1782224444.278112:0:14879:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2200/0xcfd8b3ae4b165eb9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.278120:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2200/0xcfd8b3ae4b165eb9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782224444.278136:0:14879:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1782224444.278368:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3200/0xcfd8b3ae4b165eb2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a77 expref: 22 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.278385:0:14879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2200/0xcfd8b3ae4b165eb9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a77 expref: 21 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.278404:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:3.0:1782224444.278407:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782224444.278410:0:14879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabf2f2200, rc 0) 00000100:00100000:3.0:1782224444.278447:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+21:14448:x1868797312097152:12345-192.168.202.7@tcp:101:dd.0 Request processed in 12319us (12738us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1782224444.278454:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 34 00000100:00100000:0.0:1782224444.283673:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224444.283910:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312097664 00000100:00100000:1.0:1782224444.283920:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312097664 00000100:00100000:1.0:1782224444.283981:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 35 00000100:00100000:1.0:1782224444.283993:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:243224f9-f297-4a07-ab60-b6a19179afcf+21:14448:x1868797312097664:12345-192.168.202.7@tcp:36:dd.0 00010000:00010000:1.0:1782224444.284305:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165ec7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.284341:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165ec7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.284354:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165ec7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782224444.284591:0:14221:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1782224444.284620:0:14221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a78da4a1 reply state 00000000dec3ea6c transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165ec7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224444.284630:0:14221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782224444.284847:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:243224f9-f297-4a07-ab60-b6a19179afcf+24:14448:x1868797312097664:12345-192.168.202.7@tcp:36:dd.0 Request processed in 854us (1181us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1782224444.284855:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 35 00000020:00080000:1.0:1782224444.284860:0:14221:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782224444.288773:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165ec7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.288791:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165ec7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.288799:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165ec7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.288822:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:0.0:1782224444.288827:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165ec7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.288834:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165ec7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.288852:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:0.0:1782224444.288854:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782224444.288858:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165ec7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.288864:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d55c00/0xcfd8b3ae4b165ec7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224444.290934:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224444.291419:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312097792 00000100:00100000:3.0:1782224444.291431:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312097792 00000100:00100000:3.0:1782224444.291519:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00100000:3.0:1782224444.291533:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+23:14448:x1868797312097792:12345-192.168.202.7@tcp:101:dd.0 00010000:00010000:3.0:1782224444.291563:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224444.291597:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165ece lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a7e expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.291658:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165ece lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a7e expref: 24 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.291675:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165ece lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a7e expref: 24 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.291695:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:3.0:1782224444.291698:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782224444.291701:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675800, rc 0) 00000100:00100000:3.0:1782224444.291782:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+24:14448:x1868797312097792:12345-192.168.202.7@tcp:101:dd.0 Request processed in 252us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224444.291806:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00100000:1.0:1782224444.307947:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224444.308099:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312098048 00000100:00100000:3.0:1782224444.308108:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312098048 00000100:00100000:3.0:1782224444.308168:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:3.0:1782224444.308178:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:243224f9-f297-4a07-ab60-b6a19179afcf+24:14448:x1868797312098048:12345-192.168.202.7@tcp:103:dd.0 00010000:00010000:3.0:1782224444.308193:0:14205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224444.308220:0:14205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165ece lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a7e expref: 24 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.308242:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:3.0:1782224444.308247:0:14205:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782224444.308297:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:243224f9-f297-4a07-ab60-b6a19179afcf+23:14448:x1868797312098048:12345-192.168.202.7@tcp:103:dd.0 Request processed in 121us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224444.308304:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:1.0:1782224444.310760:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224444.310839:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312098176 00000100:00100000:3.0:1782224444.310848:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312098176 00000100:00100000:3.0:1782224444.310917:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00100000:3.0:1782224444.310929:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:243224f9-f297-4a07-ab60-b6a19179afcf+23:14448:x1868797312098176:12345-192.168.202.7@tcp:58:dd.0 00010000:00010000:3.0:1782224444.311077:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b165ed5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.311097:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b165ed5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.311108:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b165ed5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782224444.312939:0:14221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782224444.313337:0:14221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1782224444.313489:0:14221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1782224444.313826:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:243224f9-f297-4a07-ab60-b6a19179afcf+23:14448:x1868797312098176:12345-192.168.202.7@tcp:58:dd.0 Request processed in 2891us (3070us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224444.313837:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00100000:0.0:1782224444.317445:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224444.317582:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312098304 00000100:00100000:3.0:1782224444.317591:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312098304 00000100:00100000:3.0:1782224444.317644:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 38 00000100:00100000:3.0:1782224444.317651:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea86107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+23:14448:x1868797312098304:12345-192.168.202.7@tcp:101:dd.0 00010000:00010000:3.0:1782224444.317672:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224444.317691:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165edc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a85 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.317845:0:14220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b165ed5 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.317855:0:14220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165edc lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a85 expref: 24 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.317872:0:14220:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b165ed5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.317881:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165edc lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a85 expref: 24 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.317890:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:3.0:1782224444.317892:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782224444.317894:0:14220:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165edc lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a85 expref: 24 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.317915:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675800, rc 0) 00000100:00100000:3.0:1782224444.317971:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea86107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+24:14448:x1868797312098304:12345-192.168.202.7@tcp:101:dd.0 Request processed in 321us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224444.317977:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 38 00000100:00100000:0.0:1782224444.500463:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782224444.500492:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabfcb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333058176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782224444.500596:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224444.500993:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333058176 00000100:00100000:3.0:1782224444.501002:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333058176 00000100:00100000:3.0:1782224444.501092:0:14859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782224444.501103:0:14859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333058176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782224444.501144:0:14859:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782224444.501197:0:14859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333058176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224444.501204:0:14859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1782224444.501284:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1782224444.501826:0:14253:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1782224444.501831:0:14253:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782224444.501917:0:14253:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1782224444.501925:0:14253:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1782224444.502075:0:14253:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7a08700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14253:1868797333058304:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782224444.502154:0:14253:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905f2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782224444.502200:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabfcb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333058176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782224444.512741:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224444.513010:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312098432 00000100:00100000:1.0:1782224444.513087:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312098432 00000100:00100000:1.0:1782224444.513158:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:1.0:1782224444.513186:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:243224f9-f297-4a07-ab60-b6a19179afcf+25:14449:x1868797312098432:12345-192.168.202.7@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1782224444.513318:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:243224f9-f297-4a07-ab60-b6a19179afcf+25:14449:x1868797312098432:12345-192.168.202.7@tcp:900:lhsmtool_posix.0 Request processed in 135us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224444.513329:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:3.0:1782224444.526509:0:14253:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7a08700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14253:1868797333058304:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782224444.526772:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224444.527141:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312098560 00000100:00100000:2.0:1782224444.527150:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312098560 00000100:00100000:2.0:1782224444.527220:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:2.0:1782224444.527230:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:243224f9-f297-4a07-ab60-b6a19179afcf+24:14449:x1868797312098560:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782224444.527265:0:14219:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782224444.527374:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:243224f9-f297-4a07-ab60-b6a19179afcf+24:14449:x1868797312098560:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 145us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224444.527407:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:0.0:1782224444.532844:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224444.533603:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312098688 00000100:00100000:2.0:1782224444.533615:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312098688 00000100:00100000:2.0:1782224444.533685:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 40 00000100:00100000:2.0:1782224444.533696:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+24:14449:x1868797312098688:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1782224444.533771:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2800/0xcfd8b3ae4b165ee3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.533789:0:14879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2800/0xcfd8b3ae4b165ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.533801:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2800/0xcfd8b3ae4b165ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.533819:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.533826:0:14879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.533842:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.533867:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165ef1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.533876:0:14879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.533882:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224444.533939:0:14879:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782224444.533943:0:14879:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782224444.533956:0:14879:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.533968:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2800/0xcfd8b3ae4b165ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.533975:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2800/0xcfd8b3ae4b165ee3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.533982:0:14879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2800/0xcfd8b3ae4b165ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.533988:0:14879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabf2f2800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224444.533992:0:14879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2800/0xcfd8b3ae4b165ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.533999:0:14879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2800/0xcfd8b3ae4b165ee3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.534011:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96ea8309b500) 00010000:00010000:2.0:1782224444.534050:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224444.534065:0:14879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2800/0xcfd8b3ae4b165ee3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.534072:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2800/0xcfd8b3ae4b165ee3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.534086:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.534102:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eea lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.534109:0:14879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.534115:0:14879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabf2f3400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224444.534118:0:14879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.534125:0:14879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eea lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.534135:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff96ea8635fd00) 00010000:00010000:2.0:1782224444.534137:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224444.534140:0:14879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eea lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.534147:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.534179:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.534186:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165ef1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.534193:0:14879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.534199:0:14879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabf2f3800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224444.534207:0:14879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.534215:0:14879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165ef1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.534223:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:2.0:1782224444.534226:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224444.534230:0:14879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165ef1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.534236:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165ef1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224444.534664:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+24:14449:x1868797312098688:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 Request processed in 968us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224444.534674:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 40 00000100:00100000:0.0:1782224444.541003:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224444.541508:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312098944 00000100:00100000:2.0:1782224444.541522:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312098944 00000100:00100000:2.0:1782224444.541617:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 41 00000100:00100000:2.0:1782224444.541628:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:243224f9-f297-4a07-ab60-b6a19179afcf+24:14449:x1868797312098944:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782224444.541657:0:14219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224444.541684:0:14219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165ef8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a8c expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.541815:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.542032:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.542076:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782224444.542089:0:14219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782224444.543141:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.543155:0:14219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eff lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.543171:0:14219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.543178:0:14219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabf2f3400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224444.543182:0:14219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.543190:0:14219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.543205:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:2.0:1782224444.543208:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782224444.543212:0:14219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eff lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.543218:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165eff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.543274:0:14219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165ef8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a8c expref: 26 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.543298:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96ea8309b500) 00010000:00010000:2.0:1782224444.543301:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782224444.543306:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165ef8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a8c expref: 26 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.543317:0:14219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabf2f3800, rc 0) 00000100:00100000:2.0:1782224444.543394:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:243224f9-f297-4a07-ab60-b6a19179afcf+25:14449:x1868797312098944:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 1767us (2403us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1782224444.543402:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 41 00000100:00100000:2.0:1782224444.550711:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224444.550965:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312099072 00000100:00100000:3.0:1782224444.550976:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312099072 00000100:00100000:3.0:1782224444.551077:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 42 00000100:00100000:3.0:1782224444.551087:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+25:14449:x1868797312099072:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782224444.551126:0:14220:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782224444.551233:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+25:14449:x1868797312099072:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 148us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224444.551240:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 42 00000100:00100000:0.0:1782224444.558911:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224444.560779:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312099328 00000100:00100000:3.0:1782224444.560793:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312099328 00000100:00100000:3.0:1782224444.560867:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00100000:3.0:1782224444.560877:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:243224f9-f297-4a07-ab60-b6a19179afcf+25:14449:x1868797312099328:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782224444.560913:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224444.560934:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675400/0xcfd8b3ae4b165f0d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a93 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782224444.561780:0:14221:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:3.0:1782224444.561790:0:14221:0:(osp_object.c:1656:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1782224444.561846:0:14221:0:(osp_object.c:1673:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:3.0:1782224444.562175:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165f14 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.562191:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165f14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.562203:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165f14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.562263:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675400/0xcfd8b3ae4b165f0d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a93 expref: 28 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.562285:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165f14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a93 expref: 27 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.562293:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96ea87df7500) 00010000:00010000:3.0:1782224444.562296:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782224444.562300:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90675200, rc 0) 00000100:00100000:3.0:1782224444.562369:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:243224f9-f297-4a07-ab60-b6a19179afcf+27:14449:x1868797312099328:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 1493us (3467us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1782224444.562377:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00100000:0.0:1782224444.571889:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224444.572076:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312099584 00000100:00100000:3.0:1782224444.572104:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312099584 00000100:00100000:3.0:1782224444.572183:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 44 00000100:00100000:3.0:1782224444.572194:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+27:14449:x1868797312099584:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782224444.572280:0:14220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224444.572313:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675200/0xcfd8b3ae4b165f14 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a93 expref: 27 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.572337:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96ea87df7500) 00010000:00010000:3.0:1782224444.572349:0:14220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782224444.572372:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165f22 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.574250:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165f22 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.574272:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165f22 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.578870:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165f29 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xbe5504de bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.578896:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165f29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbe5504de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.578908:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165f29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbe5504de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.578997:0:14220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165f22 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.579006:0:14220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165f22 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.579308:0:14220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165f22 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.579318:0:14220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224444.579338:0:14220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165f22 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.579347:0:14220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165f22 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.579361:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96ea8635f700) 00010000:00010000:2.0:1782224444.579364:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224444.579369:0:14220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165f22 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.579376:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674800/0xcfd8b3ae4b165f22 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.579467:0:14220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165f29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbe5504de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.579474:0:14220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165f29 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbe5504de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.579480:0:14220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165f29 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbe5504de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.579486:0:14220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabf2f3800 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224444.579489:0:14220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165f29 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbe5504de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.579496:0:14220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165f29 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbe5504de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.579504:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xbe5504de (ffff96ea8635fd00) 00010000:00010000:2.0:1782224444.579507:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782224444.579516:0:14220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165f29 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xbe5504de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.579522:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3800/0xcfd8b3ae4b165f29 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xbe5504de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224444.579652:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:243224f9-f297-4a07-ab60-b6a19179afcf+26:14449:x1868797312099584:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 7455us (7769us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782224444.579661:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 44 00000100:00100000:0.0:1782224444.582357:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224444.582846:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312099712 00000100:00100000:3.0:1782224444.582856:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312099712 00000100:00100000:3.0:1782224444.582920:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:3.0:1782224444.582929:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:243224f9-f297-4a07-ab60-b6a19179afcf+26:14449:x1868797312099712:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782224444.582952:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782224444.582977:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675400/0xcfd8b3ae4b165f30 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51a9a expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.583051:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674000/0xcfd8b3ae4b165f37 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.583072:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674000/0xcfd8b3ae4b165f37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.583100:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674000/0xcfd8b3ae4b165f37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.583493:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675400/0xcfd8b3ae4b165f30 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a9a expref: 28 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.583518:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674000/0xcfd8b3ae4b165f37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a9a expref: 27 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.583527:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96ea87df7f00) 00010000:00010000:3.0:1782224444.583530:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782224444.583534:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96ea90674000, rc 0) 00000100:00100000:0.0:1782224444.584373:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:243224f9-f297-4a07-ab60-b6a19179afcf+27:14449:x1868797312099712:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 1439us (2022us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224444.584394:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:0.0:1782224444.589787:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224444.590103:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312099968 00000100:00100000:2.0:1782224444.590115:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312099968 00000100:00100000:2.0:1782224444.590177:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00100000:2.0:1782224444.590188:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+27:14449:x1868797312099968:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782224444.590293:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f3e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.590313:0:14879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.590325:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782224444.590707:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1782224444.590718:0:14879:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 525370702686ns, next at 526370700221ns, rc = 0 00000004:00010000:2.0:1782224444.590811:0:14879:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d4303045 reply state 00000000c580cdcb transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224444.590821:0:14879:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782224444.590931:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+29:14449:x1868797312099968:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 744us (1167us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1782224444.590959:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00100000:1.0:1782224444.613598:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:2.0:1782224444.613748:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.613762:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f3e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.613770:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f3e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.613776:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabf2f3400 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:2.0:1782224444.613781:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f3e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.613790:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f3e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.613808:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96ea87df7f00) 00010000:00010000:2.0:1782224444.613811:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782224444.613817:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f3e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.613822:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f3e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224444.615972:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312100096 00000100:00100000:3.0:1782224444.615987:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312100096 00000100:00100000:2.0:1782224444.618563:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00100000:2.0:1782224444.618581:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabfcb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:243224f9-f297-4a07-ab60-b6a19179afcf+28:14449:x1868797312100096:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782224444.618612:0:14219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224444.618635:0:14219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f45 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51aa1 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.618720:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f45 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aa1 expref: 29 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.618736:0:14219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f45 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aa1 expref: 29 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.618769:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96ea87df7f00) 00010000:00010000:2.0:1782224444.618773:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782224444.618776:0:14219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabf2f3400, rc 0) 00000100:00100000:2.0:1782224444.618848:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabfcb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:243224f9-f297-4a07-ab60-b6a19179afcf+29:14449:x1868797312100096:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 272us (5261us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224444.618855:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00100000:1.0:1782224444.622634:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224444.623966:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312100224 00000100:00100000:0.0:1782224444.623980:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312100224 00000100:00100000:0.0:1782224444.624086:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:0.0:1782224444.624098:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:243224f9-f297-4a07-ab60-b6a19179afcf+5:2347:x1868797312100224:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1782224444.624764:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:243224f9-f297-4a07-ab60-b6a19179afcf+6:2347:x1868797312100224:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 665us (2139us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1782224444.624773:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:1.0:1782224444.629431:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224444.629514:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312100480 00000100:00100000:0.0:1782224444.629524:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312100480 00000100:00100000:0.0:1782224444.629585:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:0.0:1782224444.629595:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:243224f9-f297-4a07-ab60-b6a19179afcf+29:14449:x1868797312100480:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782224444.629848:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:243224f9-f297-4a07-ab60-b6a19179afcf+30:14449:x1868797312100480:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 252us (424us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1782224444.629855:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:1.0:1782224444.633237:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224444.633664:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312100736 00000100:00100000:2.0:1782224444.633675:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312100736 00000100:00100000:2.0:1782224444.633742:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:2.0:1782224444.633754:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+30:14449:x1868797312100736:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782224444.633878:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+30:14449:x1868797312100736:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 127us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224444.633885:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:2.0:1782224444.636863:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224444.636995:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312100864 00000100:00100000:0.0:1782224444.637005:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312100864 00000100:00100000:0.0:1782224444.637111:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:0.0:1782224444.637121:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eaa7d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:243224f9-f297-4a07-ab60-b6a19179afcf+30:14449:x1868797312100864:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782224444.637157:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782224444.637189:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b165f4c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51aa8 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.637261:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b165f53 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.637276:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b165f53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.637288:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b165f53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782224444.637324:0:14221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782224444.637344:0:14221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b165f53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.637371:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86600/0xcfd8b3ae4b165f4c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aa8 expref: 32 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.637550:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b165f53 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aa8 expref: 31 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.637560:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96ea87df7f00) 00010000:00010000:0.0:1782224444.637562:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782224444.637576:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabbb86e00, rc 0) 00000100:00100000:0.0:1782224444.637636:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eaa7d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:243224f9-f297-4a07-ab60-b6a19179afcf+31:14449:x1868797312100864:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 516us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224444.637643:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:1.0:1782224444.641607:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224444.641690:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312100992 00000100:00100000:2.0:1782224444.641700:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312100992 00000100:00100000:2.0:1782224444.641757:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:2.0:1782224444.641767:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:243224f9-f297-4a07-ab60-b6a19179afcf+6:2346:x1868797312100992:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782224444.641787:0:14855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782224444.641821:0:14855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7d07206/0xcfd8b3ae4b165f5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51aaf expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782224444.641851:0:14855:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a963c, blocks: 0x1 00010000:00010000:2.0:1782224444.641871:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1782224444.641875:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782224444.641885:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d07206/0xcfd8b3ae4b165f5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aaf expref: 7 pid: 14855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.641903:0:14855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b7d07206/0xcfd8b3ae4b165f5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aaf expref: 7 pid: 14855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.641917:0:14855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eabf2f2800, rc 0) 00000100:00100000:2.0:1782224444.641984:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:243224f9-f297-4a07-ab60-b6a19179afcf+7:2346:x1868797312100992:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 218us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224444.641991:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:1.0:1782224444.644720:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224444.644823:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312101248 00000100:00100000:2.0:1782224444.644834:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312101248 00000100:00100000:2.0:1782224444.644900:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 50 00000100:00100000:2.0:1782224444.644910:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+31:14449:x1868797312101248:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782224444.645101:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+31:14449:x1868797312101248:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 191us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224444.645109:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 50 00000100:00100000:3.0:1782224444.657111:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224444.657272:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312101376 00000100:00100000:2.0:1782224444.657285:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312101376 00000100:00100000:2.0:1782224444.657351:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:2.0:1782224444.657362:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:243224f9-f297-4a07-ab60-b6a19179afcf+31:14449:x1868797312101376:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1782224444.815699:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:0.0:1782224444.815728:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:0.0:1782224444.815749:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1782224444.816071:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782224444.816100:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eaa7d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333058432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1782224444.816198:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224444.816416:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333058432 00000100:00100000:0.0:1782224444.816427:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333058432 00000100:00100000:0.0:1782224444.816509:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782224444.816520:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333058432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1782224444.816808:0:14854:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782224444.816812:0:14854:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1782224444.816814:0:14854:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1782224444.816816:0:14854:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1782224444 -> 1782224444 00002000:00010000:0.0:1782224444.816819:0:14854:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1782224444.816874:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1868797333058432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 355us (677us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1782224444.816882:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1782224444.816931:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96eaa7d21180/2, rc 0, transno 8589934595 00000100:00100000:0.0:1782224444.816938:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eaa7d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333058432:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1782224444.817007:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782224444.817644:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:243224f9-f297-4a07-ab60-b6a19179afcf+14:14449:x1868797312101376:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 Request processed in 159928us (160187us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224444.817657:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:0.0:1782224444.832656:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224444.833389:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312101504 00000100:00100000:1.0:1782224444.833405:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312101504 00000100:00100000:1.0:1782224444.833490:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:1.0:1782224444.833502:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:243224f9-f297-4a07-ab60-b6a19179afcf+7:2346:x1868797312101504:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1782224444.833668:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:243224f9-f297-4a07-ab60-b6a19179afcf+7:2346:x1868797312101504:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 Request processed in 167us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224444.833677:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:0.0:1782224444.849972:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224444.854553:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312101760 00000100:00100000:2.0:1782224444.854645:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312101760 00000100:00100000:2.0:1782224444.854811:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 52 00000100:00100000:2.0:1782224444.854825:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+14:14449:x1868797312101760:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782224444.854896:0:14879:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224444.854933:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86e00/0xcfd8b3ae4b165f53 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aa8 expref: 14 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.854959:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96ea87df7f00) 00010000:00010000:2.0:1782224444.854964:0:14879:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782224444.855003:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2c00/0xcfd8b3ae4b165f61 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.855068:0:14879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2c00/0xcfd8b3ae4b165f61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.855080:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2c00/0xcfd8b3ae4b165f61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782224444.855354:0:14879:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007de6870e reply state 000000006fec834c transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2c00/0xcfd8b3ae4b165f61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224444.855365:0:14879:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782224444.855519:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:243224f9-f297-4a07-ab60-b6a19179afcf+15:14449:x1868797312101760:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 696us (5560us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1782224444.855549:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 52 00010000:00010000:3.0:1782224444.863512:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2c00/0xcfd8b3ae4b165f61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.863539:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2c00/0xcfd8b3ae4b165f61 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.863547:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2c00/0xcfd8b3ae4b165f61 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.863555:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabf2f2c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:3.0:1782224444.863560:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2c00/0xcfd8b3ae4b165f61 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224444.863784:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:3.0:1782224444.864006:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2c00/0xcfd8b3ae4b165f61 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.864078:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96ea87df7f00) 00010000:00010000:3.0:1782224444.864081:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782224444.864086:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2c00/0xcfd8b3ae4b165f61 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.864093:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f2c00/0xcfd8b3ae4b165f61 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224444.864186:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312101888 00000100:00100000:1.0:1782224444.864198:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312101888 00000100:00100000:1.0:1782224444.864267:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:1.0:1782224444.864278:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96e987c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:243224f9-f297-4a07-ab60-b6a19179afcf+7:14449:x1868797312101888:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782224444.864300:0:14855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782224444.864319:0:14855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165f68 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1223ba2760a51ab6 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.864368:0:14855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7d07206/0xcfd8b3ae4b165f5a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aaf expref: 8 pid: 14855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.864378:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224444.864383:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224444.864388:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165f68 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51ab6 expref: 8 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.864430:0:14855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b7d07206/0xcfd8b3ae4b165f5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aaf expref: 8 pid: 14855 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.864445:0:14855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b7d07206/0xcfd8b3ae4b165f5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aaf expref: 8 pid: 14855 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224444.864462:0:14855:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf846a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14855:1868797333058560:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224444.864693:0:14855:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea85cfed80 going to sleep for 11 seconds 00000100:00100000:3.0:1782224444.867827:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1782224444.867907:0:14855:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf846a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14855:1868797333058560:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224444.867948:0:14855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165f68 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51ab6 expref: 8 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.867975:0:14855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96eaa7d54600, rc 0) 00000100:00100000:3.0:1782224444.868072:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96e987c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:243224f9-f297-4a07-ab60-b6a19179afcf+8:14449:x1868797312101888:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 3795us (4292us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224444.868082:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:3.0:1782224444.870454:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312102016 00000100:00100000:3.0:1782224444.870470:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312102016 00010000:00010000:3.0:1782224444.870538:0:14204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d07206/0xcfd8b3ae4b165f5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aaf expref: 8 pid: 14855 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224444.871666:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:3.0:1782224444.871686:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:243224f9-f297-4a07-ab60-b6a19179afcf+8:2347:x1868797312102016:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782224444.871727:0:14204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782224444.871760:0:14204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b7d07206/0xcfd8b3ae4b165f5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aaf expref: 8 pid: 14855 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.871778:0:14204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b7d07206/0xcfd8b3ae4b165f5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aaf expref: 8 pid: 14855 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.871808:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7d07206/0xcfd8b3ae4b165f5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aaf expref: 8 pid: 14855 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.871830:0:14204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782224444.871835:0:14204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782224444.871844:0:14204:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165f68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51ab6 expref: 7 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.871855:0:14204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165f68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51ab6 expref: 7 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.871905:0:14204:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165f68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51ab6 expref: 7 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224444.871923:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf59e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14204:1868797333058688:192.168.202.7@tcp:105: 00000100:00100000:3.0:1782224444.872074:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea8820fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1782224444.880862:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224444.881089:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf59e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14204:1868797333058688:192.168.202.7@tcp:105: 00010000:00010000:2.0:1782224444.881129:0:14204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224444.881219:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:243224f9-f297-4a07-ab60-b6a19179afcf+7:2347:x1868797312102016:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 9541us (13407us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224444.881233:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:1.0:1782224444.882634:0:14854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312102144 00000100:00100000:1.0:1782224444.882649:0:14854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312102144 00000100:00100000:1.0:1782224444.882726:0:14854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:1.0:1782224444.882738:0:14854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:243224f9-f297-4a07-ab60-b6a19179afcf+7:2346:x1868797312102144:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1782224444.883001:0:14854:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782224444.883005:0:14854:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1782224444 00002000:00010000:1.0:1782224444.883008:0:14854:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1782224443 00002000:00010000:1.0:1782224444.883010:0:14854:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1782224444 -> 1782224444 00002000:00010000:1.0:1782224444.883078:0:14854:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782224444.883168:0:14854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:243224f9-f297-4a07-ab60-b6a19179afcf+8:2346:x1868797312102144:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 431us (2322us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1782224444.883178:0:14854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:3.0:1782224444.892006:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1782224444.892465:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312102272 00000100:00100000:1.0:1782224444.892480:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312102272 00000100:00100000:1.0:1782224444.892553:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:1.0:1782224444.892577:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:243224f9-f297-4a07-ab60-b6a19179afcf+8:2346:x1868797312102272:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1782224444.892644:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165f6f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.892670:0:14855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165f68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51ab6 expref: 8 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.892680:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224444.892685:0:14855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782224444.892691:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165f6f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.892738:0:14855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165f68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51ab6 expref: 8 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.892756:0:14855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165f68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51ab6 expref: 8 pid: 14855 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224444.892774:0:14855:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf844000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14855:1868797333058816:192.168.202.7@tcp:104: 00000100:00100000:1.0:1782224444.892892:0:14855:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea85cfe840 going to sleep for 11 seconds 00000100:00100000:1.0:1782224444.899831:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224444.900146:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312102400 00000100:00100000:2.0:1782224444.900270:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312102400 00010000:00010000:2.0:1782224444.900327:0:14206:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165f68 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51ab6 expref: 9 pid: 14855 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224444.900436:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:2.0:1782224444.900449:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:243224f9-f297-4a07-ab60-b6a19179afcf+9:2346:x1868797312102400:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782224444.900470:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224444.900499:0:14206:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165f68 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51ab6 expref: 9 pid: 14855 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.900516:0:14206:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165f68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51ab6 expref: 9 pid: 14855 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.900550:0:14206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782224444.900555:0:14206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782224444.900562:0:14206:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165f6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.900609:0:14206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165f6f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.900636:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224444.900714:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:243224f9-f297-4a07-ab60-b6a19179afcf+9:2346:x1868797312102400:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 267us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224444.900723:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 14 00010000:00010000:3.0:1782224444.901060:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032a283d5/0xcfd8b3ae4b165f68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51ab6 expref: 8 pid: 14855 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224444.901082:0:14855:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf844000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14855:1868797333058816:192.168.202.7@tcp:104: 00010000:00010000:3.0:1782224444.901109:0:14855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165f6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.901122:0:14855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165f6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.901131:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165f6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.901173:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165f6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.901183:0:14855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165f6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.901192:0:14855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165f6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.901200:0:14855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55c00 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224444.906221:0:14855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165f6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.906301:0:14855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165f6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.906336:0:14855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165f6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.906349:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d49f1b0/0xcfd8b3ae4b165f6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224444.906520:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:243224f9-f297-4a07-ab60-b6a19179afcf+7:2346:x1868797312102272:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 Request processed in 13950us (14523us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224444.906532:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:3.0:1782224444.911272:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224444.911616:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312102656 00000100:00100000:0.0:1782224444.911629:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312102656 00000100:00100000:0.0:1782224444.911708:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:0.0:1782224444.911719:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:243224f9-f297-4a07-ab60-b6a19179afcf+14:14449:x1868797312102656:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782224444.911836:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b165f76 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.911870:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b165f76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.911909:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b165f76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.912844:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87000/0xcfd8b3ae4b165f7d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.912866:0:14221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f45 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aa1 expref: 15 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.912876:0:14221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87000/0xcfd8b3ae4b165f7d lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.912923:0:14221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f45 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aa1 expref: 15 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.912942:0:14221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f45 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aa1 expref: 15 pid: 14219 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224444.912960:0:14221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabbbdc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14221:1868797333058944:192.168.202.7@tcp:104: 00000100:00100000:0.0:1782224444.914500:0:14221:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea905f2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782224444.926400:0:14221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabbbdc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14221:1868797333058944:192.168.202.7@tcp:104: 00010000:00010000:0.0:1782224444.926441:0:14221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87000/0xcfd8b3ae4b165f7d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224444.928718:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224444.937246:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312102784 00000100:00100000:2.0:1782224444.937273:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312102784 00010000:00010000:2.0:1782224444.937350:0:14204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f45 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aa1 expref: 16 pid: 14219 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782224444.937414:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:2.0:1782224444.937427:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:243224f9-f297-4a07-ab60-b6a19179afcf+16:2346:x1868797312102784:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782224444.937447:0:14204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782224444.937455:0:14204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f45 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aa1 expref: 16 pid: 14219 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.937473:0:14204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f45 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aa1 expref: 16 pid: 14219 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.937504:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabf2f3400/0xcfd8b3ae4b165f45 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51aa1 expref: 16 pid: 14219 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.937532:0:14204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96ea87df7f00) 00010000:00010000:2.0:1782224444.937558:0:14204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87000/0xcfd8b3ae4b165f7d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.937583:0:14204:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87000/0xcfd8b3ae4b165f7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.937592:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87000/0xcfd8b3ae4b165f7d lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.937623:0:14204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782224444.937722:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:243224f9-f297-4a07-ab60-b6a19179afcf+15:2346:x1868797312102784:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 297us (9526us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224444.937732:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 15 00010000:00010000:0.0:1782224444.942738:0:14221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87000/0xcfd8b3ae4b165f7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224444.942763:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87000/0xcfd8b3ae4b165f7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782224444.943145:0:14221:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1782224444.943357:0:14221:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1782224444.943413:0:14221:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1782224444.943528:0:14221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabbbdc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14221:1868797333059072:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1782224444.944126:0:14221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224444.944432:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333059072 00000100:00100000:3.0:1782224444.944444:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333059072 00000100:00100000:3.0:1782224444.944503:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782224444.944513:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14221:x1868797333059072:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782224444.944616:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14221:x1868797333059072:12345-0@lo:1000:mdt00_002.0 Request processed in 103us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224444.944635:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782224444.944902:0:14221:0:(client.c:2701:ptlrpc_set_wait()) set ffff96eaadb39000 going to sleep for 11 seconds 00000100:00100000:1.0:1782224444.944936:0:14221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabbbdc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14221:1868797333059072:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1782224444.945735:0:14221:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1782224444.945824:0:14221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf845c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14221:1868797333059200:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782224444.945874:0:14221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224444.945907:0:14221:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea85cfe180 going to sleep for 11 seconds 00000100:00100000:3.0:1782224444.946165:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333059200 00000100:00100000:3.0:1782224444.946172:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333059200 00000100:00100000:3.0:1782224444.946207:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782224444.946215:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14221:x1868797333059200:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782224444.946423:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14221:x1868797333059200:12345-0@lo:1000:mdt00_002.0 Request processed in 207us (547us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1782224444.946431:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782224444.946591:0:14221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf845c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14221:1868797333059200:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1782224444.946628:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87000/0xcfd8b3ae4b165f7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.946639:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87000/0xcfd8b3ae4b165f7d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.946646:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87000/0xcfd8b3ae4b165f7d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.946652:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87000 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224444.946657:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87000/0xcfd8b3ae4b165f7d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.946665:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87000/0xcfd8b3ae4b165f7d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.946681:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96ea87df7f00) 00010000:00010000:1.0:1782224444.946684:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782224444.946689:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87000/0xcfd8b3ae4b165f7d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.946707:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb87000/0xcfd8b3ae4b165f7d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.946748:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b165ed5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.946755:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b165ed5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.946761:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b165ed5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.946766:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90674a00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224444.946769:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b165ed5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.946774:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b165ed5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.946783:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:1.0:1782224444.946785:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782224444.946792:0:14221:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165edc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a85 expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.946805:0:14221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165edc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a85 expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.946816:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165edc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a85 expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.946882:0:14221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675800/0xcfd8b3ae4b165edc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0x1223ba2760a51a85 expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224444.946895:0:14221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf846300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14221:1868797333059328:192.168.202.7@tcp:105: 00000100:00100000:1.0:1782224444.947074:0:14221:0:(client.c:2701:ptlrpc_set_wait()) set ffff96ea85cfe540 going to sleep for 11 seconds 00000100:00100000:2.0:1782224444.959921:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224444.960063:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312102912 00000100:00100000:0.0:1782224444.960073:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312102912 00000100:00100000:0.0:1782224444.960130:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:0.0:1782224444.960140:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf870450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:243224f9-f297-4a07-ab60-b6a19179afcf+19:14448:x1868797312102912:12345-192.168.202.7@tcp:49:dd.0 00000100:00100000:0.0:1782224444.960276:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf870450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:243224f9-f297-4a07-ab60-b6a19179afcf+19:14448:x1868797312102912:12345-192.168.202.7@tcp:49:dd.0 Request processed in 137us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224444.960284:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:1.0:1782224444.960422:0:14221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf846300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14221:1868797333059328:192.168.202.7@tcp:105: 00010000:00010000:1.0:1782224444.960446:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b165ed5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.960458:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90674a00/0xcfd8b3ae4b165ed5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.960492:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165f84 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.960506:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165f84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.960518:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165f84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.960528:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165f84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.960535:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165f84 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.960542:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165f84 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.960566:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54c00 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224444.960571:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165f84 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.960579:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165f84 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.960591:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:1.0:1782224444.960594:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782224444.960598:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165f84 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.960603:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eaa7d54c00/0xcfd8b3ae4b165f84 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.960613:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b165f76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.960620:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b165f76 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.960626:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b165f76 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.960631:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb86000 already unused, calling callback (ffffffffc1ef74f0) 00010000:00010000:1.0:1782224444.960634:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b165f76 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.960640:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b165f76 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.960656:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96ea8635f600) 00010000:00010000:1.0:1782224444.960659:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782224444.960662:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b165f76 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224444.960668:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96eabbb86000/0xcfd8b3ae4b165f76 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224444.960963:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:243224f9-f297-4a07-ab60-b6a19179afcf+18:14449:x1868797312102656:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 49245us (49707us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1782224444.960972:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 53 00000020:00080000:1.0:1782224444.960976:0:14221:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1782224444.963329:0:14253:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1782224444.963339:0:14253:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782224444.963449:0:14253:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1782224444.963456:0:14253:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1782224444.971802:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224444.971914:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312103168 00000100:00100000:0.0:1782224444.971928:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312103168 00000100:00100000:3.0:1782224444.972248:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:3.0:1782224444.972274:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:243224f9-f297-4a07-ab60-b6a19179afcf+18:14449:x1868797312103168:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782224444.973349:0:14223:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782224444.973651:0:14223:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1782224444.973711:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675400/0xcfd8b3ae4b165f8b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.973734:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675400/0xcfd8b3ae4b165f8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.973748:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675400/0xcfd8b3ae4b165f8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.973760:0:14223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675400/0xcfd8b3ae4b165f8b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.973767:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675400/0xcfd8b3ae4b165f8b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.973774:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675400/0xcfd8b3ae4b165f8b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224444.973804:0:14223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782224444.973854:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782224444.973869:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675400/0xcfd8b3ae4b165f8b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.973881:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:2.0:1782224444.973885:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675400/0xcfd8b3ae4b165f8b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.973895:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675400/0xcfd8b3ae4b165f8b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.973914:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96ea87df7f00) 00010000:00010000:2.0:1782224444.973918:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782224444.973923:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675400/0xcfd8b3ae4b165f8b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782224444.973930:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96ea90675400/0xcfd8b3ae4b165f8b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224444.974073:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:243224f9-f297-4a07-ab60-b6a19179afcf+20:14449:x1868797312103168:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 1800us (2279us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1782224444.974097:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00000020:00080000:3.0:1782224444.974106:0:14223:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782224444.974348:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224444.974352:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782224444.974354:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782224445.076939:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224445.155416:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224445.155457:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224445.155489:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224445.155520:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224445.155534:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224445.155545:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224445.155556:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224445.155612:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1782224445.156085:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312103296 00000100:00100000:0.0:1782224445.156100:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312103296 00000100:00100000:0.0:1782224445.156189:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312103424 00000100:00100000:0.0:1782224445.156193:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312103424 00000100:00100000:0.0:1782224445.156209:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312103552 00000100:00100000:0.0:1782224445.156212:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312103552 00000100:00100000:0.0:1782224445.156223:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312103680 00000100:00100000:0.0:1782224445.156225:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312103680 00000100:00100000:0.0:1782224445.156236:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312103808 00000100:00100000:0.0:1782224445.156238:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312103808 00000100:00100000:0.0:1782224445.156249:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312103936 00000100:00100000:0.0:1782224445.156251:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312103936 00000100:00100000:0.0:1782224445.156262:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312104192 00000100:00100000:0.0:1782224445.156265:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312104192 00000100:00100000:0.0:1782224445.156299:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312104064 00000100:00100000:0.0:1782224445.156302:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312104064 00000100:00100000:0.0:1782224445.156322:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:0.0:1782224445.156333:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:243224f9-f297-4a07-ab60-b6a19179afcf+14:2349:x1868797312103296:12345-192.168.202.7@tcp:4:dd.0 00002000:00010000:0.0:1782224445.156404:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a3a963c, atime: 0x6a3a963b, ctime: 0x6a3a963c, blocks: 0x1 00010000:00010000:0.0:1782224445.156415:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165f92 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224445.156435:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=525s v=(0 0) 00010000:00010000:0.0:1782224445.156440:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224445.156448:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165f92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224445.156466:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165f92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782224445.162156:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1782224445.348909:0:14861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1782224445.348922:0:14861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1782224445.348942:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165f92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.348959:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165f92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.348969:0:14861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165f92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.348977:0:14861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87600 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224445.349036:0:14861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165f92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.349057:0:14861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165f92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.349086:0:14861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165f92 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.349094:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004819fdfd/0xcfd8b3ae4b165f92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224445.349250:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:243224f9-f297-4a07-ab60-b6a19179afcf+16:2349:x1868797312103296:12345-192.168.202.7@tcp:4:dd.0 Request processed in 192910us (193843us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1782224445.349271:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:1.0:1782224445.349318:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:1.0:1782224445.349334:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:243224f9-f297-4a07-ab60-b6a19179afcf+15:2349:x1868797312103424:12345-192.168.202.7@tcp:4:dd.0 00002000:00010000:1.0:1782224445.349665:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 1048576, mtime: 0x6a3a963c, atime: 0x6a3a963b, ctime: 0x6a3a963c, blocks: 0x803 00010000:00010000:1.0:1782224445.349675:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165f99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.349693:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1782224445.349698:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224445.349708:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165f99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.349723:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165f99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782224445.349971:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:2.0:1782224445.349999:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:2.0:1782224445.350041:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:2.0:1782224445.482581:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:1.0:1782224445.482881:0:14861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1782224445.482889:0:14861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1782224445.482910:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165f99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.482927:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165f99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.482938:0:14861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165f99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.482948:0:14861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224445.482954:0:14861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165f99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.482964:0:14861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165f99 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.482999:0:14861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165f99 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.483008:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165f99 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224445.483189:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:243224f9-f297-4a07-ab60-b6a19179afcf+11:2349:x1868797312103424:12345-192.168.202.7@tcp:4:dd.0 Request processed in 133855us (327724us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1782224445.483230:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:1.0:1782224445.483267:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:1.0:1782224445.483280:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:243224f9-f297-4a07-ab60-b6a19179afcf+10:2348:x1868797312103552:12345-192.168.202.7@tcp:4:dd.0 00002000:00010000:1.0:1782224445.483331:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6a3a963c, atime: 0x6a3a963b, ctime: 0x6a3a963c, blocks: 0x1007 00010000:00010000:1.0:1782224445.483339:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fa0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.483351:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1782224445.483356:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224445.483362:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.486079:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782224445.571001:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1782224445.571152:0:14861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1782224445.571159:0:14861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1782224445.571180:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.571194:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fa0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.571201:0:14861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fa0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.571243:0:14861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224445.571250:0:14861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fa0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.571262:0:14861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fa0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.571286:0:14861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fa0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.571293:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fa0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224445.571435:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:243224f9-f297-4a07-ab60-b6a19179afcf+10:2348:x1868797312103552:12345-192.168.202.7@tcp:4:dd.0 Request processed in 88151us (415936us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1782224445.571447:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:1.0:1782224445.571489:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:1.0:1782224445.571504:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:243224f9-f297-4a07-ab60-b6a19179afcf+9:2349:x1868797312103680:12345-192.168.202.7@tcp:4:dd.0 00002000:00010000:1.0:1782224445.571566:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a3a963c, atime: 0x6a3a963b, ctime: 0x6a3a963c, blocks: 0x1807 00010000:00010000:1.0:1782224445.571575:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165fa7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.571589:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1782224445.571594:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224445.571608:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165fa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.571622:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165fa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782224445.632911:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1782224445.633115:0:14861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1782224445.633124:0:14861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1782224445.633149:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165fa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.633165:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165fa7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.633175:0:14861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165fa7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.633184:0:14861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224445.633190:0:14861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165fa7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.633209:0:14861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165fa7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.633239:0:14861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165fa7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.633247:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f40cdef/0xcfd8b3ae4b165fa7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224445.633405:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:243224f9-f297-4a07-ab60-b6a19179afcf+9:2349:x1868797312103680:12345-192.168.202.7@tcp:4:dd.0 Request processed in 61899us (477874us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1782224445.633419:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:1.0:1782224445.633472:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:1.0:1782224445.633491:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:243224f9-f297-4a07-ab60-b6a19179afcf+8:2348:x1868797312103808:12345-192.168.202.7@tcp:4:dd.0 00002000:00010000:1.0:1782224445.633578:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a3a963c, atime: 0x6a3a963b, ctime: 0x6a3a963c, blocks: 0x2007 00010000:00010000:1.0:1782224445.633587:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.633603:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1782224445.633610:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224445.633618:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.633632:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782224445.698680:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:1.0:1782224445.698909:0:14861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:1.0:1782224445.698914:0:14861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:1.0:1782224445.698933:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.698948:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.698993:0:14861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.699001:0:14861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d55400 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224445.699007:0:14861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.699050:0:14861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.699078:0:14861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.699087:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c45df171/0xcfd8b3ae4b165fae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782224445.699359:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:243224f9-f297-4a07-ab60-b6a19179afcf+8:2348:x1868797312103808:12345-192.168.202.7@tcp:4:dd.0 Request processed in 65869us (543815us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1782224445.699442:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:1.0:1782224445.699483:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:1.0:1782224445.699497:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:243224f9-f297-4a07-ab60-b6a19179afcf+7:2349:x1868797312103936:12345-192.168.202.7@tcp:4:dd.0 00002000:00010000:1.0:1782224445.699546:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 5242880, mtime: 0x6a3a963c, atime: 0x6a3a963b, ctime: 0x6a3a963c, blocks: 0x2807 00010000:00010000:1.0:1782224445.699553:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165fb5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.699590:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1782224445.699596:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782224445.699602:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.699615:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782224445.768797:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:1.0:1782224445.768900:0:14861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:1.0:1782224445.768906:0:14861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:1.0:1782224445.768927:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.768943:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165fb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.768953:0:14861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165fb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.768961:0:14861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eaa7d54800 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:1.0:1782224445.768967:0:14861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165fb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.769292:0:14861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165fb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.769349:0:14861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165fb5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782224445.769357:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001001699c/0xcfd8b3ae4b165fb5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782224445.769873:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:243224f9-f297-4a07-ab60-b6a19179afcf+7:2349:x1868797312103936:12345-192.168.202.7@tcp:4:dd.0 Request processed in 70371us (614315us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1782224445.769887:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:0.0:1782224445.769931:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:0.0:1782224445.769945:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:243224f9-f297-4a07-ab60-b6a19179afcf+6:2349:x1868797312104192:12345-192.168.202.7@tcp:4:dd.0 00002000:00010000:0.0:1782224445.770332:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 6291456, mtime: 0x6a3a963c, atime: 0x6a3a963b, ctime: 0x6a3a963c, blocks: 0x3007 00010000:00010000:0.0:1782224445.770342:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165fbc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224445.770359:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1782224445.770375:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782224445.770384:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165fbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782224445.770401:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165fbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782224445.822536:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:3.0:1782224445.823437:0:14861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:3.0:1782224445.823445:0:14861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1782224445.823464:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165fbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224445.823481:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165fbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224445.823492:0:14861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165fbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224445.823500:0:14861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96eabbb87800 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224445.823506:0:14861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165fbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224445.823517:0:14861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165fbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224445.823545:0:14861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165fbc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224445.823641:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2525c6d/0xcfd8b3ae4b165fbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224445.823833:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:243224f9-f297-4a07-ab60-b6a19179afcf+6:2349:x1868797312104192:12345-192.168.202.7@tcp:4:dd.0 Request processed in 53885us (668266us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1782224445.823853:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:3.0:1782224445.823895:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:3.0:1782224445.823909:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:243224f9-f297-4a07-ab60-b6a19179afcf+5:2349:x1868797312104064:12345-192.168.202.7@tcp:4:dd.0 00002000:00010000:3.0:1782224445.823980:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 7654321, mtime: 0x6a3a963c, atime: 0x6a3a963b, ctime: 0x6a3a963c, blocks: 0x3807 00010000:00010000:3.0:1782224445.823987:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008202a5ca/0xcfd8b3ae4b165fc3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224445.824001:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=526s v=(0 0) 00010000:00010000:3.0:1782224445.824005:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782224445.824079:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008202a5ca/0xcfd8b3ae4b165fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224445.824095:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008202a5ca/0xcfd8b3ae4b165fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782224445.911472:0:7486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:3.0:1782224445.911682:0:14861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1782224445.911705:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008202a5ca/0xcfd8b3ae4b165fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224445.911721:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008202a5ca/0xcfd8b3ae4b165fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224445.911754:0:14861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008202a5ca/0xcfd8b3ae4b165fc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224445.911763:0:14861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96ea90675200 already unused, calling callback (ffffffffc14b9ce0) 00010000:00010000:3.0:1782224445.911770:0:14861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008202a5ca/0xcfd8b3ae4b165fc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224445.911781:0:14861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008202a5ca/0xcfd8b3ae4b165fc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224445.911809:0:14861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008202a5ca/0xcfd8b3ae4b165fc3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782224445.911819:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008202a5ca/0xcfd8b3ae4b165fc3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782224445.912109:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:243224f9-f297-4a07-ab60-b6a19179afcf+5:2349:x1868797312104064:12345-192.168.202.7@tcp:4:dd.0 Request processed in 88198us (756489us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1782224445.912122:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00010000:00010000:2.0:1782224446.101989:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224447.060456:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333059712:0@lo:400:kworker.0 00000100:00100000:3.0:1782224447.060544:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3303:1868797333059456:0@lo:400:kworker.0 00000100:00100000:2.0:1782224447.060574:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224447.060652:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333059584:0@lo:400:kworker.0 00000100:00100000:1.0:1782224447.060775:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797333059840:0@lo:400:kworker.0 00000100:00100000:3.0:1782224447.064848:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224447.065237:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333059968:0@lo:400:kworker.0 00000100:00100000:3.0:1782224447.065315:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224447.065342:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782224447.065368:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1868797333060096:0@lo:400:kworker.0 00000100:00100000:3.0:1782224447.065403:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224447.065530:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333059712 00000100:00100000:3.0:1782224447.065540:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333059712 00000100:00100000:3.0:1782224447.065615:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782224447.065628:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333059712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224447.065759:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333059712:12345-0@lo:400:kworker.0 Request processed in 65us (5118us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224447.065769:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1782224447.065796:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782224447.065831:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333059968 00000100:00100000:3.0:1782224447.065835:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333059968 00000100:00100000:3.0:1782224447.065863:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333060096 00000100:00100000:3.0:1782224447.065865:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333060096 00000100:00100000:3.0:1782224447.066147:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782224447.066157:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf59f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333059968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224447.066205:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf59f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868797333059968:12345-0@lo:400:kworker.0 Request processed in 51us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224447.066212:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782224447.066225:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782224447.066231:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96ea83360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868797333060096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224447.066258:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96ea83360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868797333060096:12345-0@lo:400:kworker.0 Request processed in 28us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224447.066265:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1782224447.066282:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782224447.066325:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1868797333060096:0@lo:400:kworker.0 00000100:00100000:3.0:1782224447.066340:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1868797333059968:0@lo:400:kworker.0 00000100:00100000:3.0:1782224447.066412:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333059456 00000100:00100000:3.0:1782224447.066418:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333059456 00000100:00100000:3.0:1782224447.066451:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782224447.066457:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:3303:x1868797333059456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224447.066496:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8+19:3303:x1868797333059456:12345-0@lo:400:kworker.0 Request processed in 38us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224447.066502:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782224447.067150:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fcd26ce7-fdbf-45d2-9d54-1817b11dfcc8:3303:1868797333059456:0@lo:400:kworker.0 00000100:00100000:0.0:1782224447.069863:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782224447.069980:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333059584 00000100:00100000:0.0:1782224447.069993:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333059584 00000100:00100000:0.0:1782224447.070097:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782224447.070122:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbbdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333059584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782224447.070215:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbbdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1868797333059584:12345-0@lo:400:kworker.0 Request processed in 98us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224447.070224:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1782224447.070252:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782224447.070301:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1868797333059584:0@lo:400:kworker.0 00000100:00100000:2.0:1782224447.070477:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1782224447.070485:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96eaa7d21180, transno 8589934595 00000004:00080000:2.0:1782224447.070510:0:3305:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1782224447.070532:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333059712:0@lo:400:kworker.0 00000100:00100000:2.0:1782224447.070554:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96ea83360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333060224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782224447.070595:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782224447.070637:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333060224 00000100:00100000:2.0:1782224447.070642:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333060224 00000100:00100000:2.0:1782224447.070676:0:14859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782224447.070683:0:14859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333060224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782224447.070722:0:14859:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1782224447.070759:0:14859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868797333060224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224447.070765:0:14859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782224447.070799:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96ea83360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1868797333060224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782224447.076422:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782224447.077565:0:14879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333059840 00000100:00100000:3.0:1782224447.077582:0:14879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333059840 00000100:00100000:3.0:1782224447.077660:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782224447.077674:0:14879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797333059840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782224447.077791:0:14879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868797333059840:12345-0@lo:400:kworker.0 Request processed in 120us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782224447.077800:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782224447.078196:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868797333059840:0@lo:400:kworker.0 00010000:00010000:0.0:1782224447.132304:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782224447.963841:0:16385:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1782224448.148255:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782224448.541306:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224448.541359:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224448.541392:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224448.541427:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224448.541450:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224448.541466:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224448.541488:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1782224448.541516:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312104576 00000100:00100000:2.0:1782224448.541528:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312104576 00000100:00100000:2.0:1782224448.541592:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312105088 00000100:00100000:2.0:1782224448.541595:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312105088 00000100:00100000:2.0:1782224448.541609:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312104704 00000100:00100000:2.0:1782224448.541612:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312104704 00000100:00100000:2.0:1782224448.541624:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312104960 00000100:00100000:2.0:1782224448.541627:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312104960 00000100:00100000:2.0:1782224448.541643:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:2.0:1782224448.541653:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:243224f9-f297-4a07-ab60-b6a19179afcf+5:2347:x1868797312104576:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224448.541746:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:243224f9-f297-4a07-ab60-b6a19179afcf+5:2347:x1868797312104576:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 94us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224448.541772:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:2.0:1782224448.541791:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:2.0:1782224448.541797:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+5:2347:x1868797312105088:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224448.541834:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+5:2347:x1868797312105088:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 36us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224448.541841:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:2.0:1782224448.541852:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:2.0:1782224448.541858:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:243224f9-f297-4a07-ab60-b6a19179afcf+5:2347:x1868797312104704:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224448.541881:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:243224f9-f297-4a07-ab60-b6a19179afcf+5:2347:x1868797312104704:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 23us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224448.541887:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:2.0:1782224448.541898:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00100000:2.0:1782224448.541904:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+5:2347:x1868797312104960:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1782224448.541924:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32540eb9-2a68-4f6c-84ca-a9039e746d4c+5:2347:x1868797312104960:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 20us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1782224448.541930:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00080000:2.0:1782224448.541950:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782224448.541955:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782224448.542138:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312104832 00000100:00100000:0.0:1782224448.542152:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312104832 00000100:00100000:0.0:1782224448.542201:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312104448 00000100:00100000:0.0:1782224448.542204:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312104448 00000100:00100000:0.0:1782224448.542225:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 32 00000100:00100000:0.0:1782224448.542232:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:2347:x1868797312104832:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224448.542270:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32540eb9-2a68-4f6c-84ca-a9039e746d4c+6:2347:x1868797312104832:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 38us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224448.542284:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 32 00000100:00100000:0.0:1782224448.542298:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:0.0:1782224448.542305:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabc88df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:243224f9-f297-4a07-ab60-b6a19179afcf+20:2347:x1868797312104448:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1782224448.542331:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabc88df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:243224f9-f297-4a07-ab60-b6a19179afcf+20:2347:x1868797312104448:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 27us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1782224448.542337:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:1.0:1782224448.542471:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797312104320 00000100:00100000:1.0:1782224448.542476:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797312104320 00000100:00100000:1.0:1782224448.542518:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 123 00000100:00100000:1.0:1782224448.542526:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabbcc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:2347:x1868797312104320:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1782224448.542554:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabbcc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:619c3a44-0550-47ff-a7c5-bf61e2d0dfbb+13:2347:x1868797312104320:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 29us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224448.542561:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 123 00000100:00080000:2.0:1782224448.542983:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782224449.172216:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782224449.622216:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96eabf844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333060352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782224449.622317:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782224449.622424:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868797333060352 00000100:00100000:1.0:1782224449.622435:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868797333060352 00000100:00100000:1.0:1782224449.622511:0:14859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782224449.622536:0:14859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96eabf844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333060352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782224449.622588:0:14859:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782224449.622650:0:14859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96eabf844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868797333060352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1782224449.622658:0:14859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1782224449.622689:0:14215:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782224449.622735:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff96eabf844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1868797333060352:0@lo:13:osp-pre-0-0.0 Debug log: 29827 lines, 29827 kept, 0 dropped, 0 bad.